00010000:00010000:1.0F:1787784857.675252:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0F:1787784857.744351:0:17087:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:3.0:1787784857.744389:0:17087:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8951df665840 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:3.0:1787784857.744395:0:17087:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8950c326a300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8951df665d80 00000020:00080000:3.0:1787784857.744398:0:17087:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8950c326ae00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8950c4244000 00000020:00080000:1.0:1787784857.744499:0:17146:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:1.0:1787784857.744570:0:17146:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0F:1787784857.753229:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e68b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784857.753265:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e68b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784857.753273:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e68b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784857.753280:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787784857.753285:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e68b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784857.753293:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e68b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784857.753312:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8950c3351f00) 00010000:00010000:2.0:1787784857.753315:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784857.753321:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e68b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784857.753327:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9e68b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17108 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784858.415957:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784858.416003:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784858.416027:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784858.416057:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728128128 00000100:00100000:2.0:1787784858.416066:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728128128 00000100:00100000:2.0:1787784858.416122:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728128000 00000100:00100000:2.0:1787784858.416125:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728128000 00000100:00100000:2.0:1787784858.416148:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 82 00000100:00100000:2.0:1787784858.416158:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff478b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41f7da42-7119-46f9-b18b-692347fcebc0+5:2407:x1874627728128128:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784858.416236:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff478b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41f7da42-7119-46f9-b18b-692347fcebc0+5:2407:x1874627728128128:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 80us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784858.416245:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 82 00000100:00100000:2.0:1787784858.416264:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 83 00000100:00100000:2.0:1787784858.416272:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41f7da42-7119-46f9-b18b-692347fcebc0+13:2407:x1874627728128000:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784858.416302:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41f7da42-7119-46f9-b18b-692347fcebc0+13:2407:x1874627728128000:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 31us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784858.416309:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 83 00000100:00080000:2.0:1787784858.416330:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787784858.416334:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0F:1787784858.416393:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728127872 00000100:00100000:0.0:1787784858.416403:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728127872 00000100:00100000:0.0:1787784858.416439:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 169 00000100:00100000:0.0:1787784858.416458:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:2407:x1874627728127872:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787784858.416498:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:2407:x1874627728127872:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 42us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784858.416504:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 169 00000100:00100000:2.0:1787784858.422097:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784858.423727:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784858.426171:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784858.426197:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784858.426216:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784858.427280:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728128256 00000100:00100000:1.0:1787784858.427291:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728128256 00000100:00100000:1.0:1787784858.427370:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728128384 00000100:00100000:1.0:1787784858.427375:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728128384 00000100:00100000:1.0:1787784858.427405:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:1.0:1787784858.427414:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff456940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41f7da42-7119-46f9-b18b-692347fcebc0+5:2408:x1874627728128384:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784858.427485:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff456940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41f7da42-7119-46f9-b18b-692347fcebc0+5:2408:x1874627728128384:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 72us (3764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784858.427492:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:1.0:1787784858.427510:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:1.0:1787784858.427516:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41f7da42-7119-46f9-b18b-692347fcebc0+5:2404:x1874627728128256:12345-192.168.202.41@tcp:9:kworker.0 00000020:00000080:1.0:1787784858.427533:0:19016:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e3ba 00000100:00080000:1.0:1787784858.427548:0:19016:0:(import.c:65:import_set_state_nolock()) ffff8950c360e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787784858.427688:0:19016:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1787784858.427847:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41f7da42-7119-46f9-b18b-692347fcebc0+2:2404:x1874627728128256:12345-192.168.202.41@tcp:9:kworker.0 Request processed in 330us (5759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784858.427855:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:1.0:1787784858.427879:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728128640 00000100:00100000:1.0:1787784858.427883:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728128640 00000100:00100000:1.0:1787784858.427912:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728128512 00000100:00100000:1.0:1787784858.427915:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728128512 00000100:00100000:1.0:1787784858.427938:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 84 00000100:00100000:1.0:1787784858.427944:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff457c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2408:x1874627728128640:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784858.427972:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff457c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2408:x1874627728128640:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784858.427992:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 84 00000100:00100000:1.0:1787784858.428005:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 85 00000100:00100000:1.0:1787784858.428011:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff454b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:2408:x1874627728128512:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784858.428037:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff454b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:2408:x1874627728128512:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 26us (1840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784858.428042:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 85 00010000:00010000:1.0:1787784858.428090:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787784858.428477:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784858.428482:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787784858.428484:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787784858.428487:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784858.428583:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784858.428713:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728128768 00000100:00100000:0.0:1787784858.428718:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728128768 00000100:00100000:0.0:1787784858.428754:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728128896 00000100:00100000:0.0:1787784858.428757:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728128896 00000100:00100000:0.0:1787784858.428798:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:0.0:1787784858.428806:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff455e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2404:x1874627728128768:12345-192.168.202.41@tcp:9:kworker.0 00000020:00000080:0.0:1787784858.428831:0:18614:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e3f9 00000100:00080000:0.0:1787784858.428838:0:18614:0:(import.c:65:import_set_state_nolock()) ffff8951ff091800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787784858.428872:0:18614:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787784858.428965:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff455e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e18bf9c7-fc9c-4760-9682-7ca1091799a6+2:2404:x1874627728128768:12345-192.168.202.41@tcp:9:kworker.0 Request processed in 159us (2746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784858.428972:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:0.0:1787784858.428984:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:0.0:1787784858.428991:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff455680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2404:x1874627728128896:12345-192.168.202.41@tcp:9:kworker.0 00000020:00000080:0.0:1787784858.429001:0:18614:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e400 00000100:00080000:0.0:1787784858.429008:0:18614:0:(import.c:65:import_set_state_nolock()) ffff8951ff092800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787784858.429025:0:18614:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1787784858.429108:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff455680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e18bf9c7-fc9c-4760-9682-7ca1091799a6+2:2404:x1874627728128896:12345-192.168.202.41@tcp:9:kworker.0 Request processed in 117us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784858.429115:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 35 00010000:00010000:2.0:1787784858.429219:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787784858.429225:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787784858.429228:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787784858.429395:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784858.694382:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784859.718858:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784859.784670:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff456d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750226816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787784859.784753:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784859.784832:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750226816 00000100:00100000:1.0:1787784859.784839:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750226816 00000100:00100000:1.0:1787784859.784895:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787784859.784903:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c34121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750226816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787784859.784931:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787784859.784971:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c34121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750226816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784859.784977:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787784859.784998:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784859.785031:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff456d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750226816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787784860.294038:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784860.294065:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c121b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750226944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784860.294136:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784860.294230:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750226944 00000100:00100000:3.0:1787784860.294238:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750226944 00000100:00100000:3.0:1787784860.294286:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787784860.294295:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff457840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750226944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787784860.294328:0:17112:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1787784860.294381:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff457840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750226944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784860.294388:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787784860.294442:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c121b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750226944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784860.333556:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784860.333643:0:19997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728129024 00000100:00100000:0.0:1787784860.333654:0:19997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728129024 00000100:00100000:0.0:1787784860.333735:0:19997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:0.0:1787784860.333746:0:19997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41f7da42-7119-46f9-b18b-692347fcebc0+13:15585:x1874627728129024:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787784860.333973:0:19997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:41f7da42-7119-46f9-b18b-692347fcebc0+13:15585:x1874627728129024:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 Request processed in 227us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784860.333981:0:19997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00080000:2.0:1787784860.334050:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784860.348016:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784860.354531:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728129152 00000100:00100000:1.0:1787784860.354545:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728129152 00000100:00100000:1.0:1787784860.354637:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 66 00000100:00100000:1.0:1787784860.354649:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff456580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+5:15585:x1874627728129152:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 00000100:00080000:3.0:1787784860.354900:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787784860.355068:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff456580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+5:15585:x1874627728129152:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 Request processed in 421us (7515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784860.355077:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 66 00000100:00100000:3.0:1787784860.360900:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784860.361060:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728129408 00000100:00100000:0.0:1787784860.361069:0:17111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728129408 00000100:00100000:0.0:1787784860.361119:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:0.0:1787784860.361129:0:17111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c121b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41f7da42-7119-46f9-b18b-692347fcebc0+13:15585:x1874627728129408:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787784860.361382:0:17111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c121b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41f7da42-7119-46f9-b18b-692347fcebc0+14:15585:x1874627728129408:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 254us (492us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1787784860.361391:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 12 00000040:00080000:0.0:1787784860.504849:0:17861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787784860.742096:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784860.806166:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784860.806189:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750227072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784860.806255:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784860.806435:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750227072 00000100:00100000:2.0:1787784860.806453:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750227072 00000100:00100000:2.0:1787784860.806517:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787784860.806526:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750227072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787784860.806545:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1787784860.806632:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784860.806707:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750227072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 182us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784860.806715:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787784860.806808:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750227072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784860.806979:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c1219680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750227200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784860.807020:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784860.807171:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750227200 00000100:00100000:2.0:1787784860.807175:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750227200 00000100:00100000:2.0:1787784860.807206:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787784860.807212:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750227200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787784860.807235:0:17113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787784860.807279:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750227200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784860.807285:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787784860.807392:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c1219680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750227200:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787784861.766107:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784861.830941:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784861.830967:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c4d46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750227328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787784861.831333:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787784861.831347:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750227456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784861.831433:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784861.831509:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750227456 00000100:00100000:1.0:1787784861.831518:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750227456 00000100:00100000:1.0:1787784861.831595:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787784861.831606:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750227456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784861.831637:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787784861.831700:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750227456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784861.831708:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1787784861.831745:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784861.831794:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750227456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784861.832214:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784861.832378:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750227328 00000100:00100000:1.0:1787784861.832383:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750227328 00000100:00100000:1.0:1787784861.832441:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787784861.832449:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d45e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750227328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787784861.832462:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787784861.832494:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d45e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750227328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784861.832512:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1787784861.832691:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784861.832763:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c4d46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750227328:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784861.841534:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750227968:0@lo:400:kworker.0 00000100:00100000:0.0:1787784861.841632:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784861.841886:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750228480:0@lo:400:kworker.0 00000100:00100000:0.0:1787784861.841916:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784861.841944:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787784861.841950:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff454f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a45ddeb3-718a-48eb-8507-e0c94319fca6:3646:1874627750227584:0@lo:400:kworker.0 00000100:00100000:0.0:1787784861.841980:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784861.842016:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff454780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750228096:0@lo:400:kworker.0 00000100:00100000:0.0:1787784861.842042:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784861.842060:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff456d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750228608:0@lo:400:kworker.0 00000100:00100000:0.0:1787784861.842079:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784861.842110:0:19997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750227968 00000100:00100000:0.0:1787784861.842118:0:19997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750227968 00000100:00100000:0.0:1787784861.842164:0:19997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750228480 00000100:00100000:0.0:1787784861.842167:0:19997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750228480 00000100:00100000:0.0:1787784861.842197:0:19997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750228608 00000100:00100000:0.0:1787784861.842199:0:19997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750228608 00000100:00100000:0.0:1787784861.842217:0:19997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787784861.842226:0:19997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750227968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784861.842282:0:19997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750227968:12345-0@lo:400:kworker.0 Request processed in 56us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784861.842289:0:19997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787784861.842307:0:19997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787784861.842313:0:19997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750228480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784861.842354:0:19997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750228480:12345-0@lo:400:kworker.0 Request processed in 41us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784861.842361:0:19997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787784861.842373:0:19997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787784861.842378:0:19997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4166d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750228608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784861.842404:0:19997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4166d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750228608:12345-0@lo:400:kworker.0 Request processed in 26us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784861.842410:0:19997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787784861.842443:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750227584 00000100:00100000:0.0:1787784861.842447:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750227584 00000100:00100000:0.0:1787784861.842471:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787784861.842476:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:3646:x1874627750227584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784861.842506:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:3646:x1874627750227584:12345-0@lo:400:kworker.0 Request processed in 30us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784861.842512:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:0.0:1787784861.842568:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787784861.842573:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784861.842599:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff454f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a45ddeb3-718a-48eb-8507-e0c94319fca6:3646:1874627750227584:0@lo:400:kworker.0 00010000:00080000:0.0:1787784861.842613:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff456d00 x1874627750228608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784861.842625:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff456d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750228608:0@lo:400:kworker.0 00000100:00100000:0.0:1787784861.842636:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750227968:0@lo:400:kworker.0 00000100:00100000:0.0:1787784861.842645:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750228480:0@lo:400:kworker.0 00000100:00100000:0.0:1787784861.844948:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff455a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750227840:0@lo:400:kworker.0 00000100:00100000:0.0:1787784861.845051:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784861.845089:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750228352:0@lo:400:kworker.0 00000100:00100000:0.0:1787784861.845110:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784861.845132:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787784861.845139:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750227712:0@lo:400:kworker.0 00000100:00100000:0.0:1787784861.845161:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784861.845178:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750228224:0@lo:400:kworker.0 00000100:00100000:0.0:1787784861.845195:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784861.845228:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750227840 00000100:00100000:0.0:1787784861.845237:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750227840 00000100:00100000:0.0:1787784861.845282:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750228224 00000100:00100000:0.0:1787784861.845285:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750228224 00000100:00100000:0.0:1787784861.845313:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787784861.845320:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750227840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784861.845372:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750227840:12345-0@lo:400:kworker.0 Request processed in 52us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784861.845379:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787784861.845395:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787784861.845401:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff454f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750228224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784861.847533:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750228096 00000100:00100000:2.0:1787784861.847736:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750228096 00000100:00100000:2.0:1787784861.847815:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750227712 00000100:00100000:2.0:1787784861.847819:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750227712 00000100:00100000:2.0:1787784861.847838:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787784861.847846:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750228096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784861.847931:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750228096:12345-0@lo:400:kworker.0 Request processed in 86us (5887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784861.847938:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787784861.847956:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787784861.847962:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff456d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750227712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784861.847992:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff456d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750227712:12345-0@lo:400:kworker.0 Request processed in 30us (2830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784861.848015:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787784861.848074:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff454780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750228096:0@lo:400:kworker.0 00000100:00100000:2.0:1787784861.848138:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff020f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750228736:0@lo:400:kworker.0 00000100:00100000:2.0:1787784861.848175:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784861.848202:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784861.848209:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff023840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750228864:0@lo:400:kworker.0 00000100:00100000:2.0:1787784861.848228:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784861.848253:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750228352 00000100:00100000:2.0:1787784861.848257:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750228352 00000100:00100000:2.0:1787784861.848282:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750228736 00000100:00100000:2.0:1787784861.848285:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750228736 00000100:00100000:2.0:1787784861.848301:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750228864 00000100:00100000:2.0:1787784861.848303:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750228864 00000100:00100000:2.0:1787784861.848318:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787784861.848325:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750228352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784861.848359:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750228352:12345-0@lo:400:kworker.0 Request processed in 34us (3248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784861.848365:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787784861.848378:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787784861.848388:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff021680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874627750228736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784861.848660:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787784861.848686:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff022940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750228864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784861.848824:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff021680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874627750228736:12345-0@lo:400:kworker.0 Request processed in 438us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784861.848831:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787784861.848929:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff454f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750228224:12345-0@lo:400:kworker.0 Request processed in 3526us (3730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784861.848937:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1787784861.848961:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787784861.848966:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784861.848968:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784861.848989:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750227712:0@lo:400:kworker.0 00000100:00100000:0.0:1787784861.849020:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750228224:0@lo:400:kworker.0 00000100:00100000:0.0:1787784861.849034:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff455a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750227840:0@lo:400:kworker.0 00000100:00100000:0.0:1787784861.849043:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750228352:0@lo:400:kworker.0 00000100:00100000:1.0:1787784861.852144:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff022940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750228864:12345-0@lo:400:kworker.0 Request processed in 3466us (3904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784861.852160:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1787784861.852993:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951ff023840 x1874627750228864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784861.853013:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff023840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750228864:0@lo:400:kworker.0 00000100:00100000:0.0:1787784861.853174:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff020f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750228736:0@lo:400:kworker.0 00010000:00010000:2.0:1787784862.790070:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784863.520467:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784863.520515:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784863.520544:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784863.520574:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784863.520593:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784863.520615:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784863.520643:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728129664 00000100:00100000:2.0:1787784863.520665:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728129664 00000100:00100000:2.0:1787784863.520727:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728130176 00000100:00100000:2.0:1787784863.520731:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728130176 00000100:00100000:2.0:1787784863.520743:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728129792 00000100:00100000:2.0:1787784863.520745:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728129792 00000100:00100000:2.0:1787784863.520754:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728130048 00000100:00100000:2.0:1787784863.520756:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728130048 00000100:00100000:2.0:1787784863.520791:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 92 00000100:00100000:2.0:1787784863.520801:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff023c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+14:2406:x1874627728129664:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784863.520893:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff023c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+14:2406:x1874627728129664:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 93us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784863.520901:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 92 00000100:00100000:2.0:1787784863.520918:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 93 00000100:00100000:2.0:1787784863.520925:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2406:x1874627728130176:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784863.520950:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2406:x1874627728130176:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 25us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784863.520956:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 93 00000100:00100000:2.0:1787784863.520970:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 94 00000100:00100000:2.0:1787784863.520975:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff021e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+5:2406:x1874627728129792:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784863.521009:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff021e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+5:2406:x1874627728129792:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 34us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784863.521014:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 94 00000100:00100000:2.0:1787784863.521025:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 95 00000100:00100000:2.0:1787784863.521030:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:2406:x1874627728130048:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784863.521050:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:2406:x1874627728130048:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 19us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784863.521055:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 95 00000100:00100000:2.0:1787784863.521072:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728129536 00000100:00100000:2.0:1787784863.521075:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728129536 00000100:00100000:2.0:1787784863.521098:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 171 00000100:00100000:2.0:1787784863.521104:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:2406:x1874627728129536:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787784863.521125:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:2406:x1874627728129536:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 23us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784863.521131:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 171 00000100:00080000:2.0:1787784863.521161:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787784863.521165:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784863.521482:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728129920 00000100:00100000:1.0:1787784863.521487:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728129920 00000100:00100000:1.0:1787784863.521536:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:1.0:1787784863.521544:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff020b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41f7da42-7119-46f9-b18b-692347fcebc0+5:2406:x1874627728129920:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784863.521593:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff020b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41f7da42-7119-46f9-b18b-692347fcebc0+5:2406:x1874627728129920:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 50us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784863.521600:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00080000:2.0:1787784863.521752:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787784863.820763:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787784863.879696:0:18609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e18bf9c7-fc9c-4760-9682-7ca1091799a6 00000020:00000080:1.0:1787784863.879706:0:18609:0:(genops.c:885:class_export_put()) final put ffff8951ff091000/e18bf9c7-fc9c-4760-9682-7ca1091799a6 00000001:00100000:1.0:1787784863.879746:0:18609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 41f7da42-7119-46f9-b18b-692347fcebc0 00000020:00000080:1.0:1787784863.879749:0:18609:0:(genops.c:885:class_export_put()) final put ffff8950c360d800/41f7da42-7119-46f9-b18b-692347fcebc0 00000020:00000080:2.0:1787784863.879954:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8951ff091000/e18bf9c7-fc9c-4760-9682-7ca1091799a6 for lustre-OST0000 00000020:00000080:2.0:1787784863.880002:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c360d800/41f7da42-7119-46f9-b18b-692347fcebc0 for lustre-OST0000 00000020:00000080:2.0:1787784863.880020:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951ff091800 for lustre-OST0000 00000020:00000080:2.0:1787784863.880023:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c360e800 for lustre-OST0000 00000001:00080000:2.0:1787784863.882533:0:17087:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1787784863.882547:0:17087:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:1.0:1787784863.883275:0:17146:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:1.0:1787784863.883299:0:17146:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000001:00100000:0.0:1787784863.894479:0:19429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e18bf9c7-fc9c-4760-9682-7ca1091799a6 00000020:00000080:0.0:1787784863.894489:0:19429:0:(genops.c:885:class_export_put()) final put ffff8951ff094800/e18bf9c7-fc9c-4760-9682-7ca1091799a6 00000020:00000080:1.0:1787784863.894968:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951ff094800/e18bf9c7-fc9c-4760-9682-7ca1091799a6 for lustre-OST0001 00000020:00000080:0.0:1787784863.895091:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951ff092800 for lustre-OST0001 00000001:02000400:0.0:1787784864.129194:0:20485:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 18:54:22 (1787784862) 00010000:00010000:1.0:1787784864.842796:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784864.902212:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750228992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787784864.902281:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784864.902621:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750228992 00000100:00100000:1.0:1787784864.902628:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750228992 00000100:00100000:1.0:1787784864.902703:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787784864.902713:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff455a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750228992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787784864.902752:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787784864.902829:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff455a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750228992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784864.902836:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787784864.902845:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750228992:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787784864.903674:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784865.414142:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750229120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787784865.414211:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784865.414595:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750229120 00000100:00100000:3.0:1787784865.414602:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750229120 00000100:00100000:3.0:1787784865.414670:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787784865.414680:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750229120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787784865.414715:0:17623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1787784865.414787:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750229120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784865.414796:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787784865.414849:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750229120:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787784865.864301:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784865.925951:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750229248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784865.926022:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784865.926101:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750229248 00000100:00100000:0.0:1787784865.926108:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750229248 00000100:00100000:0.0:1787784865.926153:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787784865.926162:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff454780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750229248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787784865.926196:0:17113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787784865.926239:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff454780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750229248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784865.926247:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787784865.926316:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750229248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784865.926651:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff022d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750229376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784865.926681:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784865.926759:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750229376 00000100:00100000:2.0:1787784865.926792:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750229376 00000100:00100000:2.0:1787784865.926835:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787784865.926842:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff4561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750229376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787784865.926857:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787784865.926890:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff4561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750229376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784865.926896:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1787784865.926959:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784865.926984:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff022d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750229376:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787784866.694731:0:17141:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787784866.694742:0:17141:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787784866.694785:0:17141:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787784866.694795:0:17141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1787784866.886022:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784866.950233:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c56292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750229760:0@lo:400:kworker.0 00000100:00100000:0.0:1787784866.950314:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784866.950402:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750229760 00000100:00100000:0.0:1787784866.950409:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750229760 00000100:00100000:0.0:1787784866.950448:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787784866.950456:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750229760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784866.950498:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750229760:12345-0@lo:400:kworker.0 Request processed in 43us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784866.950505:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787784866.950542:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c56292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750229760:0@lo:400:kworker.0 00000100:00100000:0.0:1787784866.950573:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c56292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750229888:0@lo:400:kworker.0 00000100:00100000:0.0:1787784866.950596:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784866.950658:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5629a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750230272:0@lo:400:kworker.0 00000100:00100000:0.0:1787784866.950678:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784866.950737:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750230400:0@lo:400:kworker.0 00000100:00100000:0.0:1787784866.950756:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784866.950800:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750229888 00000100:00100000:0.0:1787784866.950803:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750229888 00000100:00100000:0.0:1787784866.950826:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750230272 00000100:00100000:0.0:1787784866.950828:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750230272 00000100:00100000:0.0:1787784866.950846:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750230400 00000100:00100000:0.0:1787784866.950849:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750230400 00000100:00100000:0.0:1787784866.950859:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787784866.950864:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c5628f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750229888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784866.950893:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c5628f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750229888:12345-0@lo:400:kworker.0 Request processed in 29us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784866.950899:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787784866.950908:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787784866.950914:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750230272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784866.950934:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750230272:12345-0@lo:400:kworker.0 Request processed in 21us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784866.950939:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787784866.950946:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787784866.950951:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750230400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784866.950969:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750230400:12345-0@lo:400:kworker.0 Request processed in 19us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784866.950974:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1787784866.950986:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787784866.950989:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784866.951004:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750230400:0@lo:400:kworker.0 00000100:00100000:0.0:1787784866.951013:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c56292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750229888:0@lo:400:kworker.0 00000100:00100000:0.0:1787784866.951030:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5629a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750230272:0@lo:400:kworker.0 00000100:00100000:0.0:1787784866.951059:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750230784:0@lo:400:kworker.0 00000100:00100000:0.0:1787784866.951080:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784866.951112:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874627750230912:0@lo:400:kworker.0 00000100:00100000:0.0:1787784866.951135:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784866.951239:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a45ddeb3-718a-48eb-8507-e0c94319fca6:3646:1874627750229504:0@lo:400:kworker.0 00000100:00100000:2.0:1787784866.951271:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784866.951298:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750230016:0@lo:400:kworker.0 00000100:00100000:2.0:1787784866.951316:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784866.951329:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750230528:0@lo:400:kworker.0 00000100:00100000:2.0:1787784866.951344:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784866.951354:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750231040:0@lo:400:kworker.0 00000100:00100000:2.0:1787784866.951369:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784866.951383:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787784866.951388:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750229632:0@lo:400:kworker.0 00000100:00100000:2.0:1787784866.951405:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784866.951419:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c56283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750230144:0@lo:400:kworker.0 00000100:00100000:2.0:1787784866.951434:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784866.951446:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750230656:0@lo:400:kworker.0 00000100:00100000:2.0:1787784866.951470:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784866.951488:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750230784 00000100:00100000:2.0:1787784866.951492:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750230784 00000100:00100000:2.0:1787784866.951515:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750230912 00000100:00100000:2.0:1787784866.951518:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750230912 00000100:00100000:2.0:1787784866.951528:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750230016 00000100:00100000:2.0:1787784866.951529:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750230016 00000100:00100000:2.0:1787784866.951538:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750230528 00000100:00100000:2.0:1787784866.951539:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750230528 00000100:00100000:2.0:1787784866.951547:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750231040 00000100:00100000:2.0:1787784866.951549:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750231040 00000100:00100000:2.0:1787784866.951557:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750230656 00000100:00100000:2.0:1787784866.951559:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750230656 00000100:00100000:2.0:1787784866.951569:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787784866.951574:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750230784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784866.951608:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750230784:12345-0@lo:400:kworker.0 Request processed in 33us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784866.951614:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787784866.951638:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787784866.951643:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874627750230912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784866.951674:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874627750230912:12345-0@lo:400:kworker.0 Request processed in 30us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784866.951679:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787784866.951692:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787784866.951703:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff021a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750230016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784866.951734:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff021a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750230016:12345-0@lo:400:kworker.0 Request processed in 32us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784866.951740:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787784866.951763:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787784866.951793:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff020780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750230528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784866.951828:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750229632 00000100:00100000:1.0:1787784866.951834:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750229632 00000100:00100000:2.0:1787784866.951836:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff020780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750230528:12345-0@lo:400:kworker.0 Request processed in 67us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784866.951844:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787784866.951857:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787784866.951866:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750231040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784866.951878:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750230144 00000100:00100000:1.0:1787784866.951882:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750230144 00000100:00100000:2.0:1787784866.951897:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750231040:12345-0@lo:400:kworker.0 Request processed in 33us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784866.951903:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787784866.951909:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787784866.951914:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750229632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784866.951927:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787784866.951936:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750230656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784866.951960:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750229632:12345-0@lo:400:kworker.0 Request processed in 49us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784866.951969:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787784866.951977:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750230656:12345-0@lo:400:kworker.0 Request processed in 42us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784866.951984:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787784866.951989:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787784866.951999:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff022580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750230144:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787784866.952009:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787784866.952013:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787784866.952035:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874627750230912:0@lo:400:kworker.0 00000100:00100000:3.0:1787784866.952113:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750231168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784866.952183:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750229504 00000100:00100000:0.0:1787784866.952187:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750229504 00000100:00100000:0.0:1787784866.952215:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787784866.952222:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:3646:x1874627750229504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784866.954346:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff022580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750230144:12345-0@lo:400:kworker.0 Request processed in 2275us (2836us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784866.954361:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787784866.954459:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c1219680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750231296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784866.954505:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787784866.954549:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951fd7c12c0 x1874627750230784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784866.954563:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750230784:0@lo:400:kworker.0 00000100:00100000:1.0:1787784866.954597:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750231296 00000100:00100000:1.0:1787784866.954603:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750231296 00000100:00100000:1.0:1787784866.954650:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787784866.955059:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c35761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750231296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784866.955089:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787784866.955130:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c35761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750231296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784866.955137:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787784866.955176:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c1219680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750231296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784866.961035:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750229632:0@lo:400:kworker.0 00000100:00100000:2.0:1787784866.961059:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c56283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750230144:0@lo:400:kworker.0 00000100:00100000:2.0:1787784866.961075:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750230656:0@lo:400:kworker.0 00000100:00100000:2.0:1787784866.961092:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750230016:0@lo:400:kworker.0 00000100:00100000:2.0:1787784866.961104:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750230528:0@lo:400:kworker.0 00000100:00100000:3.0:1787784866.961121:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787784866.961145:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951fd7c1a40 x1874627750231040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784866.961157:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750231040:0@lo:400:kworker.0 00000100:00100000:0.0:1787784866.961344:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:3646:x1874627750229504:12345-0@lo:400:kworker.0 Request processed in 9120us (10070us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784866.961365:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787784866.961372:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750231168 00000100:00100000:1.0:1787784866.961382:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750231168 00000100:00100000:1.0:1787784866.961476:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787784866.961486:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750231168:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787784866.961501:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a45ddeb3-718a-48eb-8507-e0c94319fca6:3646:1874627750229504:0@lo:400:kworker.0 00002000:00000024:1.0:1787784866.961512:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787784866.961567:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750231168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784866.961574:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787784866.961621:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750231168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787784867.785962:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784867.786071:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728130432 00000100:00100000:1.0:1787784867.786081:0:17110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728130432 00000100:00100000:1.0:1787784867.786163:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:1.0:1787784867.786174:0:17110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41f7da42-7119-46f9-b18b-692347fcebc0+13:16347:x1874627728130432:12345-192.168.202.41@tcp:35:umount.0 00000001:00080000:1.0:1787784867.786423:0:17110:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1787784867.786521:0:17110:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:1.0:1787784867.786657:0:17110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41f7da42-7119-46f9-b18b-692347fcebc0+16:16347:x1874627728130432:12345-192.168.202.41@tcp:35:umount.0 Request processed in 484us (704us total) trans 8589934626 rc 0/0 00000100:00100000:1.0:1787784867.786664:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00000020:00080000:1.0:1787784867.786668:0:17110:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:2.0:1787784867.786944:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784867.793250:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784867.793330:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784867.793368:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784867.793498:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728130560 00000100:00100000:1.0:1787784867.793506:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728130816 00000100:00100000:0.0:1787784867.793515:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728130560 00000100:00100000:1.0:1787784867.793517:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728130816 00000100:00100000:0.0:1787784867.793603:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728130688 00000100:00100000:0.0:1787784867.793609:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728130688 00000100:00100000:1.0:1787784867.794020:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:1.0:1787784867.794036:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c1218b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+15:2405:x1874627728130560:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784867.794058:0:17092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784867.794090:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d34600/0x88ace7295d9e397 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72da3 expref: 15 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784867.794115:0:17092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784867.795798:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c1218b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+14:2405:x1874627728130560:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 1736us (2534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784867.795816:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:1.0:1787784867.796407:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:1.0:1787784867.796429:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c403b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+13:2405:x1874627728130816:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784867.796459:0:17092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784867.797403:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d35200/0x88ace7295d9e45b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e8a expref: 13 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784867.797429:0:17092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784867.798997:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c403b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+12:2405:x1874627728130816:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 2567us (5653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784867.799015:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:1.0:1787784867.799126:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:1.0:1787784867.799139:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c1218f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+11:2405:x1874627728130688:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784867.799160:0:17092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784867.799186:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d35600/0x88ace7295d9e39e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72dd4 expref: 11 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784867.799228:0:17092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784867.799344:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c1218f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+10:2405:x1874627728130688:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 137us (5903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784867.799352:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:2.0:1787784867.812920:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784867.812999:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728130944 00000100:00100000:0.0:1787784867.813015:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728130944 00000100:00100000:0.0:1787784867.813099:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:0.0:1787784867.813110:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff022d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41f7da42-7119-46f9-b18b-692347fcebc0+5:2404:x1874627728130944:12345-192.168.202.41@tcp:9:umount.0 00000020:00000080:0.0:1787784867.813147:0:18612:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e3c1 00000100:00080000:0.0:1787784867.813156:0:18612:0:(import.c:65:import_set_state_nolock()) ffff8951ff028800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787784867.813202:0:18612:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1787784867.813360:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff022d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41f7da42-7119-46f9-b18b-692347fcebc0+2:2404:x1874627728130944:12345-192.168.202.41@tcp:9:umount.0 Request processed in 252us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784867.813367:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00080000:2.0:1787784867.813797:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787784867.813837:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784867.860736:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784867.860922:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728131840 00000100:00100000:2.0:1787784867.860935:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728131840 00000100:00100000:2.0:1787784867.861012:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00100000:2.0:1787784867.861023:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+16:2404:x1874627728131840:12345-192.168.202.41@tcp:39:umount.0 00000020:00000080:2.0:1787784867.861083:0:18636:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e3ac 00000020:00010000:2.0:1787784867.861107:0:18636:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8950c2646000: total 0 00000100:00080000:2.0:1787784867.861113:0:18636:0:(import.c:65:import_set_state_nolock()) ffff8951cfe45000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787784867.861151:0:18636:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:2.0:1787784867.861356:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41f7da42-7119-46f9-b18b-692347fcebc0+15:2404:x1874627728131840:12345-192.168.202.41@tcp:39:umount.0 Request processed in 334us (636us total) trans 8589934627 rc 0/0 00000100:00100000:2.0:1787784867.861365:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 67 00000020:00010000:3.0:1787784867.861594:0:17096:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8950c2646000: total 0 00010000:00010000:3.0:1787784867.861600:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784867.861675:0:17096:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8950c2646000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1787784867.861722:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951fa991600) 00010000:00010000:3.0:1787784867.861727:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787784867.861738:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183200/0x88ace7295d9e4d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ea6 expref: 14 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784867.861760:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8950c3351f00) 00010000:00010000:3.0:1787784867.861763:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787784867.861825:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602e00/0x88ace7295d9e661 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f24 expref: 13 pid: 19997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784867.861852:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8950c3351600) 00010000:00010000:3.0:1787784867.861854:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787784867.861858:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9e477 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e91 expref: 12 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784867.861874:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8950c23c8a00) 00010000:00010000:3.0:1787784867.861877:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787784867.861900:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151e400/0x88ace7295d9e557 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ed0 expref: 11 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784867.861922:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:3.0:1787784867.861925:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787784867.861929:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fc00/0x88ace7295d9e606 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f0f expref: 10 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784867.861945:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:3.0:1787784867.861947:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787784867.861950:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628600/0x88ace7295d9e5d5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72efa expref: 9 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784867.861963:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8950c3351a00) 00010000:00010000:3.0:1787784867.861966:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787784867.861970:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603e00/0x88ace7295d9e6c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f47 expref: 8 pid: 19997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784867.861984:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8951fa991300) 00010000:00010000:3.0:1787784867.861987:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784867.861990:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183400/0x88ace7295d9e493 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e98 expref: 7 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784867.862003:0:17096:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8950c2646000, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1787784867.862017:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784867.862019:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784867.862021:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784867.890705:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784867.890828:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728131968 00000100:00100000:1.0:1787784867.890842:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728131968 00000100:00100000:1.0:1787784867.890932:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00100000:1.0:1787784867.890945:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+5:2404:x1874627728131968:12345-192.168.202.41@tcp:39:umount.0 00000020:00000080:1.0:1787784867.890989:0:17108:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e3b3 00000100:00080000:1.0:1787784867.891009:0:17108:0:(import.c:65:import_set_state_nolock()) ffff8951ff02a000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787784867.891037:0:17108:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1787784867.891319:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41f7da42-7119-46f9-b18b-692347fcebc0+3:2404:x1874627728131968:12345-192.168.202.41@tcp:39:umount.0 Request processed in 376us (629us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787784867.891327:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00080000:2.0:1787784867.891965:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787784867.892678:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784867.910400:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784868.649109:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784868.649184:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784868.649224:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784868.649356:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728132224 00000100:00100000:1.0:1787784868.649370:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728132224 00000100:00100000:3.0:1787784868.649445:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728132352 00000100:00100000:3.0:1787784868.649468:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728132352 00000100:00100000:1.0:1787784868.649478:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 102 00000100:00100000:1.0:1787784868.649493:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:2405:x1874627728132224:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784868.649523:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 103 00000100:00100000:3.0:1787784868.649543:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2406:x1874627728132352:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784868.649605:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:2405:x1874627728132224:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 115us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784868.649623:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 102 00000100:00100000:2.0:1787784868.649710:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728132096 00000100:00100000:2.0:1787784868.649716:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728132096 00000100:00100000:2.0:1787784868.649753:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 173 00000100:00100000:2.0:1787784868.649761:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+10:2406:x1874627728132096:12345-192.168.202.41@tcp:400:kworker.0 00000100:00080000:0.0:1787784868.649892:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787784868.649898:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784868.651075:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2406:x1874627728132352:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 1526us (1841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784868.651090:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 103 00000100:00100000:2.0:1787784868.657568:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+10:2406:x1874627728132096:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 7787us (8362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784868.657589:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 173 00010000:00010000:3.0:1787784868.938636:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784869.959360:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784870.026286:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784870.026323:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c36c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750231424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784870.026423:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784870.026539:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750231424 00000100:00100000:1.0:1787784870.026567:0:18617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750231424 00000100:00100000:1.0:1787784870.026668:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787784870.026680:0:18617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c121a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750231424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787784870.026721:0:18617:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787784870.026942:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c36c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750231424:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787784870.027091:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784870.027190:0:18617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c121a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750231424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 512us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784870.027201:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787784870.534160:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c121b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750231552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784870.534278:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784870.534410:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750231552 00000100:00100000:3.0:1787784870.534422:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750231552 00000100:00100000:3.0:1787784870.534493:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787784870.534505:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff020f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750231552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787784870.534555:0:17113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1787784870.534632:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff020f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750231552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784870.534640:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787784870.535152:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c121b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750231552:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1787784870.728587:0:17861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787784870.857741:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784870.857840:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784870.857901:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784870.858026:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728132480 00000100:00100000:1.0:1787784870.858039:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728132480 00000100:00100000:1.0:1787784870.858123:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728132736 00000100:00100000:1.0:1787784870.858126:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728132736 00000100:00100000:1.0:1787784870.858141:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728132608 00000100:00100000:1.0:1787784870.858143:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728132608 00000100:00100000:1.0:1787784870.858159:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:1.0:1787784870.858168:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+12:2405:x1874627728132480:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784870.858188:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784870.858215:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df603000/0x88ace7295d9e3d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e13 expref: 12 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784870.858237:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784870.858304:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+11:2405:x1874627728132480:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 137us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784870.858312:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:1.0:1787784870.858460:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:1.0:1787784870.858467:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+10:2405:x1874627728132736:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784870.858475:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784870.858484:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d35000/0x88ace7295d9e454 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e83 expref: 10 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784870.858507:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784870.858542:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+9:2405:x1874627728132736:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 75us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784870.858549:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:1.0:1787784870.858582:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:1.0:1787784870.858600:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+8:2405:x1874627728132608:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784870.858609:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784870.858618:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df603800/0x88ace7295d9e3dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72e44 expref: 8 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784870.858627:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784870.858648:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+7:2405:x1874627728132608:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 60us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784870.858654:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:1.0:1787784870.874523:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784870.874693:0:19997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728132992 00000100:00100000:0.0:1787784870.874705:0:19997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728132992 00000100:00100000:0.0:1787784870.874847:0:19997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 69 00000100:00100000:0.0:1787784870.874860:0:19997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c36c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e18bf9c7-fc9c-4760-9682-7ca1091799a6+6:2404:x1874627728132992:12345-192.168.202.41@tcp:39:umount.0 00000020:00000080:0.0:1787784870.874916:0:19997:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e3eb 00000020:00010000:0.0:1787784870.874927:0:19997:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8950c272e800: total 0 00000100:00080000:0.0:1787784870.874934:0:19997:0:(import.c:65:import_set_state_nolock()) ffff8950c2728000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787784870.874975:0:19997:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:0.0:1787784870.875188:0:19997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c36c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2404:x1874627728132992:12345-192.168.202.41@tcp:39:umount.0 Request processed in 331us (686us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1787784870.875198:0:19997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 69 00000100:00080000:2.0:1787784870.875486:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1787784870.875806:0:19445:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8950c272e800: total 0 00010000:00010000:3.0:1787784870.875875:0:19445:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8950c272e800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787784870.875924:0:19445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951fa991600) 00010000:00010000:3.0:1787784870.875928:0:19445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787784870.875940:0:19445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4183600/0x88ace7295d9e4e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72ead expref: 4 pid: 17109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784870.875967:0:19445:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8950c272e800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787784870.875999:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784870.876001:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784870.876003:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784870.887445:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784870.887705:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728133120 00000100:00100000:2.0:1787784870.887719:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728133120 00000100:00100000:2.0:1787784870.887859:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 70 00000100:00100000:2.0:1787784870.887872:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff478f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18bf9c7-fc9c-4760-9682-7ca1091799a6+5:2404:x1874627728133120:12345-192.168.202.41@tcp:39:umount.0 00000020:00000080:2.0:1787784870.887929:0:17109:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e3f2 00000100:00080000:2.0:1787784870.887942:0:17109:0:(import.c:65:import_set_state_nolock()) ffff8950c272e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787784870.887980:0:17109:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:3.0:1787784870.888013:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784870.888272:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff478f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18bf9c7-fc9c-4760-9682-7ca1091799a6+3:2404:x1874627728133120:12345-192.168.202.41@tcp:39:umount.0 Request processed in 401us (842us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787784870.888282:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 70 00000100:00080000:0.0:1787784870.889461:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787784870.950077:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784870.950227:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728133376 00000100:00100000:2.0:1787784870.950240:0:17102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728133376 00000100:00100000:2.0:1787784870.950323:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 174 00000100:00100000:2.0:1787784870.950335:0:17102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+7:2404:x1874627728133376:12345-192.168.202.41@tcp:251:umount.0 00000020:00000080:2.0:1787784870.950408:0:17102:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e389 00000020:00010000:2.0:1787784870.950418:0:17102:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8951fd5bb000: total 0 00000100:00080000:2.0:1787784870.950424:0:17102:0:(import.c:65:import_set_state_nolock()) ffff8951fd5be800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787784870.950543:0:17102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cb1bd3c-6bfa-442d-a41e-20c87a4d4182+3:2404:x1874627728133376:12345-192.168.202.41@tcp:251:umount.0 Request processed in 210us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784870.950571:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 174 00000020:00010000:3.0:1787784870.950854:0:17095:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8951fd5bb000: total 0 00010000:00010000:3.0:1787784870.950923:0:17095:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8951fd5bb000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787784870.950968:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d34a00/0x88ace7295d9e390 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72d9c expref: 2 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784870.950985:0:17095:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8951fd5bb000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787784870.950996:0:17095:0:(genops.c:885:class_export_put()) final put ffff8951fd5bb000/1cb1bd3c-6bfa-442d-a41e-20c87a4d4182 00010000:00010000:3.0:1787784870.951013:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784870.951016:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784870.951017:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787784870.953270:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fd5bb000/1cb1bd3c-6bfa-442d-a41e-20c87a4d4182 for MGS 00000020:00000080:2.0:1787784870.953356:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951fd5be800 for MGS 00010000:00010000:3.0:1787784870.984067:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784871.046067:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784871.046103:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750231680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784871.046209:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784871.046321:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750231680 00000100:00100000:0.0:1787784871.046333:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750231680 00000100:00100000:0.0:1787784871.046414:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787784871.046424:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750231680:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784871.046823:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787784871.046837:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff023840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750231808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784871.046884:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784871.046990:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750231808 00000100:00100000:3.0:1787784871.046995:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750231808 00000100:00100000:3.0:1787784871.047051:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787784871.047060:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3413840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750231808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784871.047080:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787784871.047138:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3413840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750231808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784871.047146:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787784871.047196:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff023840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750231808:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787784871.047269:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00000024:0.0:1787784871.047334:0:17623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787784871.047573:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750231680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1148us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784871.047611:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787784871.057747:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750231680:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787784872.006160:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784872.073339:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a45ddeb3-718a-48eb-8507-e0c94319fca6:3645:1874627750231936:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.073414:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784872.073460:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750232448:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.073485:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784872.073505:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750232960:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.073524:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784872.073540:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951efef2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750233472:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.073558:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784872.073591:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787784872.073598:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750232320:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.073622:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784872.073641:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5629680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750232832:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.073661:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784872.073677:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c56292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874627750233344:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.073696:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784872.073726:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750232064:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.073752:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784872.073788:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750232576:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.073809:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784872.073826:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c56283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750233088:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.073846:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784872.073865:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787784872.073880:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750232192:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.073904:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784872.073922:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750232704:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.073941:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784872.073957:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5629a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750233216:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.073976:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784872.074007:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750231936 00000100:00100000:0.0:1787784872.074015:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750231936 00000100:00100000:0.0:1787784872.074067:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787784872.074076:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c2607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:3645:x1874627750231936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.074133:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c2607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:3645:x1874627750231936:12345-0@lo:400:kworker.0 Request processed in 58us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784872.074141:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787784872.074159:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a45ddeb3-718a-48eb-8507-e0c94319fca6:3645:1874627750231936:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.074173:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750232448 00000100:00100000:0.0:1787784872.074176:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750232448 00000100:00100000:0.0:1787784872.074194:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750232960 00000100:00100000:0.0:1787784872.074197:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750232960 00000100:00100000:0.0:1787784872.074218:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750233472 00000100:00100000:0.0:1787784872.074220:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750233472 00000100:00100000:0.0:1787784872.074243:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750233344 00000100:00100000:0.0:1787784872.074246:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750233344 00000100:00080000:3.0:1787784872.074257:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784872.074257:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750233088 00000100:00100000:0.0:1787784872.074259:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750233088 00000100:00080000:3.0:1787784872.074261:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787784872.074269:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784872.074269:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750233216 00000100:00100000:0.0:1787784872.074271:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750233216 00000100:00100000:0.0:1787784872.074293:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787784872.074299:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750232448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.074340:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750232448:12345-0@lo:400:kworker.0 Request processed in 41us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784872.074357:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787784872.074370:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787784872.074376:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750232960:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787784872.074379:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787784872.074405:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750232960:12345-0@lo:400:kworker.0 Request processed in 30us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784872.074411:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787784872.074421:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787784872.074427:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750233472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.074449:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750233472:12345-0@lo:400:kworker.0 Request processed in 23us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784872.074453:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787784872.074459:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787784872.074463:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874627750233344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.074476:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874627750233344:12345-0@lo:400:kworker.0 Request processed in 14us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784872.074480:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787784872.074485:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787784872.074489:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750233088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.074512:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750233088:12345-0@lo:400:kworker.0 Request processed in 22us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784872.074518:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787784872.074528:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787784872.074533:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750233216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784872.074538:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c56283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750233088:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.074564:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750233216:12345-0@lo:400:kworker.0 Request processed in 31us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784872.074605:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787784872.074635:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750232320 00000100:00100000:0.0:1787784872.074639:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750232320 00000100:00100000:0.0:1787784872.074664:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750232832 00000100:00100000:0.0:1787784872.074667:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750232832 00000100:00100000:0.0:1787784872.074679:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750232192 00000100:00100000:0.0:1787784872.074681:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750232192 00000100:00100000:0.0:1787784872.074691:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750232704 00000100:00100000:0.0:1787784872.074693:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750232704 00000100:00100000:0.0:1787784872.074706:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787784872.074712:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750232320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.074754:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750232320:12345-0@lo:400:kworker.0 Request processed in 42us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784872.074761:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1787784872.074788:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c5629a40 x1874627750233216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784872.074789:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787784872.074795:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750232832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784872.074800:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5629a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750233216:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.074823:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750232832:12345-0@lo:400:kworker.0 Request processed in 28us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784872.074829:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787784872.074838:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787784872.074842:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750232192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.074870:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750232192:12345-0@lo:400:kworker.0 Request processed in 27us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784872.074876:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787784872.074886:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787784872.074892:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750232704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784872.074893:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750232192:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.074930:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750232704:12345-0@lo:400:kworker.0 Request processed in 38us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784872.074937:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787784872.074964:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750232064 00000100:00100000:0.0:1787784872.074968:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750232064 00000100:00100000:0.0:1787784872.074990:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750232576 00000100:00100000:0.0:1787784872.074993:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750232576 00000100:00100000:0.0:1787784872.075005:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787784872.075010:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750232064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.075042:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750232064:12345-0@lo:400:kworker.0 Request processed in 32us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784872.075048:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787784872.075060:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787784872.075061:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750232704:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.075066:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750232576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784872.075077:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750232064:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.075090:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750232576:12345-0@lo:400:kworker.0 Request processed in 26us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784872.075092:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750232576:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.075096:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1787784872.075125:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787784872.075128:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784872.075143:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750232320:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.075152:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5629680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750232832:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.075160:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c56292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1874627750233344:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.075168:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750232448:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.075177:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750232960:0@lo:400:kworker.0 00010000:00080000:0.0:1787784872.075196:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951efef2940 x1874627750233472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784872.075204:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951efef2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750233472:0@lo:400:kworker.0 00000100:00100000:0.0:1787784872.084165:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784872.084189:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951efef2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750233600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784872.084259:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784872.084313:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750233600 00000100:00100000:3.0:1787784872.084321:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750233600 00000100:00100000:3.0:1787784872.084382:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787784872.084393:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750233600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784872.084421:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787784872.084469:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750233600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784872.084476:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787784872.084519:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951efef2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750233600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784872.086181:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750233728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784872.086232:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784872.089352:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750233728 00000100:00100000:3.0:1787784872.089424:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750233728 00000100:00100000:3.0:1787784872.089470:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787784872.089478:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750233728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787784872.089502:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787784872.089597:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750233728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (3363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784872.089604:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787784872.090471:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750233728:0@lo:13:osp-pre-1-1.0 00000020:01000004:3.0:1787784872.866192:0:20681:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787784872.892441:0:20681:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787784872.892514:0:20681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182800/0x88ace7295d9df4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9df53 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784872.892530:0:20681:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182800/0x88ace7295d9df4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9df53 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784872.892537:0:20681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182800/0x88ace7295d9df4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9df53 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784872.892544:0:20681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8950c4182800/0x88ace7295d9df4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9df53 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784872.892582:0:20681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787784872.892587:0:20681:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787784872.892616:0:20681:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787784872.892620:0:20681:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787784872.892627:0:20681:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787784872.892654:0:20681:0:(import.c:65:import_set_state_nolock()) ffff8951fa908800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787784872.892814:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c121b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874627750233856:0@lo:39:umount.0 00000100:00100000:1.0:1787784872.892884:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784872.893010:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750233856 00000100:00100000:3.0:1787784872.893018:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750233856 00000100:00100000:3.0:1787784872.893061:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787784872.893069:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874627750233856:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787784872.893093:0:18636:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9df7d 00000100:00080000:3.0:1787784872.893101:0:18636:0:(import.c:65:import_set_state_nolock()) ffff8951f67db800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787784872.893168:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3643:x1874627750233856:12345-0@lo:39:umount.0 Request processed in 97us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784872.893189:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:3.0:1787784872.893198:0:18636:0:(genops.c:885:class_export_put()) final put ffff8951f67df000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787784872.893224:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f67df000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787784872.893276:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951f67db800 for lustre-MDT0000 00000100:00080000:1.0:1787784872.893618:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951fa908800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787784872.893633:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c121b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874627750233856:0@lo:39:umount.0 00010000:00010000:0.0:1787784872.893703:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784872.893712:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8950c4182800/0x88ace7295d9df4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9df53 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.893720:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182800 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784872.893723:0:17095:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8950c4182800/0x88ace7295d9df4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9df53 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.893732:0:17095:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8950c4182800/0x88ace7295d9df4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9df53 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784872.893738:0:17095:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8950c4182800/0x88ace7295d9df4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9df53 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784872.893743:0:17095:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787784872.893745:0:17095:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787784872.893748:0:17095:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787784872.893799:0:17095:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8950c4182800/0x88ace7295d9df4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9df53 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.893813:0:17095:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784872.893844:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8950c4182800/0x88ace7295d9df4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9df53 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.893852:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8950c4182800/0x88ace7295d9df4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9df53 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.893865:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784872.893866:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784872.893868:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784872.893875:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784872.893885:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951efef3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a45ddeb3-718a-48eb-8507-e0c94319fca6:3645:1874627750233984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784872.893921:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784872.894006:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750233984 00000100:00100000:1.0:1787784872.894011:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750233984 00000100:00100000:1.0:1787784872.894054:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787784872.894062:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:3645:x1874627750233984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787784872.894084:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784872.894097:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c3712000/0x88ace7295d9df53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9df4c expref: 24 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784872.894109:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784872.894143:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:3645:x1874627750233984:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784872.894150:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787784872.894176:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951efef3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a45ddeb3-718a-48eb-8507-e0c94319fca6:3645:1874627750233984:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784872.894944:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787784872.895886:0:20681:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787784872.895892:0:20681:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787784872.895898:0:20681:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787784872.897087:0:20681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182e00/0x88ace7295d9de9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9dea4 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784872.897104:0:20681:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182e00/0x88ace7295d9de9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9dea4 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784872.897112:0:20681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182e00/0x88ace7295d9de9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9dea4 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784872.897119:0:20681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8950c4182e00/0x88ace7295d9de9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9dea4 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784872.897377:0:20681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784872.897386:0:20681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e2a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e2b0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784872.897393:0:20681:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e2a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e2b0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784872.897399:0:20681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e2a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9e2b0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784872.897422:0:20681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e2a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9e2b0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.897649:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787784872.897657:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8950c4182e00/0x88ace7295d9de9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9dea4 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.897664:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182e00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784872.897670:0:17096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8950c4182e00/0x88ace7295d9de9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9dea4 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.897679:0:17096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8950c4182e00/0x88ace7295d9de9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9dea4 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784872.897686:0:17096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8950c4182e00/0x88ace7295d9de9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9dea4 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784872.897691:0:17096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787784872.897694:0:17096:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1787784872.897736:0:17096:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8950c4182e00/0x88ace7295d9de9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9dea4 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.897743:0:17096:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784872.897803:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8950c4182e00/0x88ace7295d9de9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9dea4 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.897811:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8950c4182e00/0x88ace7295d9de9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9dea4 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.897825:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784872.897828:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e2a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9e2b0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.897834:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628000 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784872.897837:0:17096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e2a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9e2b0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.897843:0:17096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e2a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9e2b0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784872.897849:0:17096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e2a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9e2b0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784872.897854:0:17096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787784872.897856:0:17096:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1787784872.897867:0:17096:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e2a9 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9e2b0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.897872:0:17096:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784872.897886:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e2a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9e2b0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.897903:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784872.897904:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784872.897906:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784872.897929:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784872.897948:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951efef2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a45ddeb3-718a-48eb-8507-e0c94319fca6:3647:1874627750234240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784872.898035:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784872.898186:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951efef3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a45ddeb3-718a-48eb-8507-e0c94319fca6:3645:1874627750234112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784872.898217:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784872.898323:0:20136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750234240 00000100:00100000:0.0:1787784872.898330:0:20136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750234240 00000100:00100000:0.0:1787784872.898387:0:20136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750234112 00000100:00100000:0.0:1787784872.898390:0:20136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750234112 00000100:00100000:0.0:1787784872.898412:0:20136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787784872.898420:0:20136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb255e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:3647:x1874627750234240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784872.898434:0:20136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787784872.898621:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787784872.898632:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c403a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45ddeb3-718a-48eb-8507-e0c94319fca6+24:3645:x1874627750234112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787784872.898641:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784872.898655:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1628200/0x88ace7295d9dea4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9de9d expref: 24 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784872.898669:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784872.898707:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c403a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45ddeb3-718a-48eb-8507-e0c94319fca6+23:3645:x1874627750234112:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784872.898714:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787784872.898751:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951efef3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a45ddeb3-718a-48eb-8507-e0c94319fca6:3645:1874627750234112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784872.898830:0:20136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1628400/0x88ace7295d9e2b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9e2a9 expref: 22 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.898840:0:20136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784872.898880:0:20136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb255e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:3647:x1874627750234240:12345-0@lo:103:ldlm_bl.0 Request processed in 460us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784872.898887:0:20136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787784872.899023:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951efef2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a45ddeb3-718a-48eb-8507-e0c94319fca6:3647:1874627750234240:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784872.899144:0:20681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787784872.899151:0:20681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e2a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9e2b0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784872.899162:0:20681:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787784872.899181:0:20681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9e446 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e44d expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784872.899189:0:20681:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9e446 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e44d expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784872.899195:0:20681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9e446 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9e44d expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784872.899202:0:20681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9e446 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9e44d expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.899232:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784872.899238:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9e446 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9e44d expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.899244:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d34c00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784872.899248:0:17095:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9e446 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9e44d expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.899268:0:17095:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9e446 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9e44d expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784872.899275:0:17095:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9e446 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9e44d expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784872.899280:0:17095:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787784872.899282:0:17095:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1787784872.899302:0:17095:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9e446 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9e44d expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.899308:0:17095:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784872.899334:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9e446 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9e44d expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784872.899423:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb255e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a45ddeb3-718a-48eb-8507-e0c94319fca6:3647:1874627750234368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784872.899463:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784872.899507:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750234368 00000100:00100000:1.0:1787784872.899511:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750234368 00000100:00100000:1.0:1787784872.899540:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787784872.899547:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45ddeb3-718a-48eb-8507-e0c94319fca6+21:3647:x1874627750234368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787784872.899555:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784872.899564:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c4183a00/0x88ace7295d9e44d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9e446 expref: 21 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784872.899583:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784872.899606:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a45ddeb3-718a-48eb-8507-e0c94319fca6+20:3647:x1874627750234368:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784872.899612:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787784872.899636:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb255e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a45ddeb3-718a-48eb-8507-e0c94319fca6:3647:1874627750234368:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784872.899727:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784872.899729:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784872.899731:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784872.899947:0:20681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787784872.899953:0:20681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951e1d34c00/0x88ace7295d9e446 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9e44d expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784872.899963:0:20681:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787784872.899968:0:20681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4183e00/0x88ace7295d9de8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9de96 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784872.899974:0:20681:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4183e00/0x88ace7295d9de8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9de96 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784872.899987:0:20681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4183e00/0x88ace7295d9de8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9de96 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784872.899994:0:20681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8950c4183e00/0x88ace7295d9de8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9de96 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.900091:0:19445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784872.900096:0:19445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8950c4183e00/0x88ace7295d9de8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9de96 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.900103:0:19445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4183e00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784872.900106:0:19445:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8950c4183e00/0x88ace7295d9de8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9de96 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.900113:0:19445:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8950c4183e00/0x88ace7295d9de8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9de96 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784872.900119:0:19445:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8950c4183e00/0x88ace7295d9de8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9de96 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784872.900131:0:19445:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787784872.900133:0:19445:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:3.0:1787784872.900210:0:20681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:3.0:1787784872.900214:0:20681:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:3.0:1787784872.900217:0:20681:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1787784872.900219:0:20681:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1787784872.900252:0:20681:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787784872.900256:0:20681:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1787784872.900260:0:20681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784872.900267:0:20681:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1787784872.900272:0:20681:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8950c2644000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787784872.900277:0:20681:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8951c7765000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787784872.900281:0:20681:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8951efedd000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787784872.900285:0:20681:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8951c85a3000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787784872.900292:0:20681:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8950c272e800 e18bf9c7-fc9c-4760-9682-7ca1091799a6 192.168.202.41@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1787784872.900297:0:20681:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8950c2646000 41f7da42-7119-46f9-b18b-692347fcebc0 192.168.202.41@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:3.0:1787784872.900302:0:20681:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8951cfef19b8) has exports, disconnecting them 00000020:00080000:3.0:1787784872.900306:0:20681:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8950c2644000), last request at 1787784872 00000020:00000080:3.0:1787784872.900313:0:20681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e278 00000100:00080000:3.0:1787784872.900329:0:20681:0:(import.c:65:import_set_state_nolock()) ffff8950c2645000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787784872.900487:0:20681:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8950c2644000): rc 0 00000020:00000080:3.0:1787784872.900495:0:20681:0:(genops.c:885:class_export_put()) final put ffff8950c2644000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:1.0:1787784872.902955:0:19445:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8950c4183e00/0x88ace7295d9de8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9de96 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784872.902971:0:19445:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784872.903004:0:19445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8950c4183e00/0x88ace7295d9de8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9de96 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784872.903012:0:19445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8950c4183e00/0x88ace7295d9de8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9de96 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784872.903028:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784872.903030:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787784872.903611:0:20681:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8951c7765000), last request at 1787784872 00000020:00000080:3.0:1787784872.903621:0:20681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e11a 00000100:00080000:3.0:1787784872.903631:0:20681:0:(import.c:65:import_set_state_nolock()) ffff8951c7767000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787784872.903699:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784872.903812:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784872.903833:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a45ddeb3-718a-48eb-8507-e0c94319fca6:3645:1874627750234496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784872.903899:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784872.903968:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750234496 00000100:00100000:0.0:1787784872.903975:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750234496 00000100:00100000:0.0:1787784872.904027:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787784872.904036:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb254000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+20:3645:x1874627750234496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784872.904048:0:17092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784872.904066:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c3712800/0x88ace7295d9de96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9de8f expref: 20 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784872.904080:0:17092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784872.904114:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb254000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a45ddeb3-718a-48eb-8507-e0c94319fca6+19:3645:x1874627750234496:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784872.904121:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787784872.904157:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a45ddeb3-718a-48eb-8507-e0c94319fca6:3645:1874627750234496:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1787784872.905842:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c2644000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787784872.905906:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c2645000 for lustre-MDT0000 00000020:00080000:3.0:1787784872.910114:0:20681:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8951c7765000): rc 0 00000020:00000080:3.0:1787784872.910120:0:20681:0:(genops.c:885:class_export_put()) final put ffff8951c7765000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1787784872.910132:0:20681:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8951efedd000), last request at 1787784788 00000020:00000080:3.0:1787784872.910140:0:20681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e06b 00000100:00080000:3.0:1787784872.910150:0:20681:0:(import.c:65:import_set_state_nolock()) ffff8951efeda800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787784872.910159:0:20681:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8951efedd000): rc 0 00000020:00000080:3.0:1787784872.910161:0:20681:0:(genops.c:885:class_export_put()) final put ffff8951efedd000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1787784872.910166:0:20681:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8951c85a3000), last request at 1787784788 00000020:00000080:3.0:1787784872.910169:0:20681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e002 00000100:00080000:3.0:1787784872.910172:0:20681:0:(import.c:65:import_set_state_nolock()) ffff8951c2ce3000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787784872.910179:0:20681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:3.0:1787784872.910273:0:20681:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8951c85a3000): rc 0 00000004:00000080:3.0:1787784872.910280:0:20681:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb77a00c97ae0 00000100:00080000:3.0:1787784872.910302:0:20681:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787784872.910306:0:20681:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:0.0:1787784872.910871:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787784872.910884:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951c7765000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787784872.910941:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951efedd000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787784872.910964:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951c7767000 for lustre-MDT0000 00000020:00000080:0.0:1787784872.910969:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951efeda800 for lustre-MDT0000 00000100:00080000:3.0:1787784872.912828:0:20681:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787784872.912863:0:20681:0:(import.c:65:import_set_state_nolock()) ffff8951eff2a800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787784872.913057:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c1218b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750234624:0@lo:39:umount.0 00000100:00100000:0.0:1787784872.913128:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784872.913188:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750234624 00000100:00100000:0.0:1787784872.913195:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750234624 00000100:00100000:0.0:1787784872.913242:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787784872.913250:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb256d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1874627750234624:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787784872.913278:0:17112:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e095 00000100:00080000:0.0:1787784872.913286:0:17112:0:(import.c:65:import_set_state_nolock()) ffff8951c85a5000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787784872.913307:0:17112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787784872.913610:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb256d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3643:x1874627750234624:12345-0@lo:39:umount.0 Request processed in 359us (481us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787784872.913619:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00010000:0.0:1787784872.913646:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787784872.913678:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951eff2a800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787784872.913685:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c1218b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750234624:0@lo:39:umount.0 00000100:00080000:3.0:1787784872.913852:0:20681:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787784872.913857:0:20681:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:3.0:1787784872.913873:0:20681:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787784872.913941:0:20681:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787784872.913955:0:20681:0:(import.c:65:import_set_state_nolock()) ffff8951c642d800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787784872.913963:0:20681:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787784872.913966:0:20681:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:3.0:1787784872.913987:0:20681:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787784872.914055:0:20681:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787784872.914067:0:20681:0:(import.c:65:import_set_state_nolock()) ffff8951c3238800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787784872.914108:0:20681:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8951cfef19b8) has no exports 00000100:00100000:0.0:1787784872.914318:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c1219680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750234752:0@lo:9:umount.0 00000100:00100000:0.0:1787784872.914367:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784872.914397:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c1218f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750234880:0@lo:9:umount.0 00000100:00100000:0.0:1787784872.914417:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784872.914463:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750234752 00000100:00100000:0.0:1787784872.914469:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750234752 00000100:00100000:0.0:1787784872.914496:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750234880 00000100:00100000:0.0:1787784872.914499:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750234880 00000100:00100000:0.0:1787784872.914516:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787784872.914523:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb255a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874627750234752:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787784872.914540:0:18614:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e160 00000100:00080000:0.0:1787784872.914547:0:18614:0:(import.c:65:import_set_state_nolock()) ffff8951c41da800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787784872.914608:0:18614:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787784872.914711:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb255a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3643:x1874627750234752:12345-0@lo:9:umount.0 Request processed in 188us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784872.914719:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787784872.914731:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787784872.914737:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb254780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1874627750234880:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787784872.914746:0:18614:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e2b7 00000100:00080000:0.0:1787784872.914751:0:18614:0:(import.c:65:import_set_state_nolock()) ffff8950c2646800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787784872.914789:0:18614:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1787784872.914863:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb254780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3643:x1874627750234880:12345-0@lo:9:umount.0 Request processed in 127us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784872.914870:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:0.0:1787784872.915285:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787784872.915310:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951c642d800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787784872.915330:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787784872.915332:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787784872.915336:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c1219680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750234752:0@lo:9:umount.0 00000100:00080000:0.0:1787784872.915412:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951c3238800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787784872.915419:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787784872.915421:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787784872.915424:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c1218f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750234880:0@lo:9:umount.0 00000001:00100000:3.0:1787784872.919478:0:17087:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787784872.919488:0:17087:0:(genops.c:885:class_export_put()) final put ffff8951c85a3000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1787784872.919507:0:17087:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e18bf9c7-fc9c-4760-9682-7ca1091799a6 00000001:00080000:3.0:1787784872.919514:0:17087:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:3.0:1787784872.919517:0:17087:0:(genops.c:885:class_export_put()) final put ffff8950c272e800/e18bf9c7-fc9c-4760-9682-7ca1091799a6 00000001:00100000:3.0:1787784872.919523:0:17087:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 41f7da42-7119-46f9-b18b-692347fcebc0 00000001:00080000:3.0:1787784872.919528:0:17087:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:3.0:1787784872.919537:0:17087:0:(genops.c:885:class_export_put()) final put ffff8950c2646000/41f7da42-7119-46f9-b18b-692347fcebc0 00000020:00000080:0.0:1787784872.919743:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8951c85a3000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1787784872.919814:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c272e800/e18bf9c7-fc9c-4760-9682-7ca1091799a6 for lustre-MDT0000 00000020:00000080:0.0:1787784872.919841:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c2646000/41f7da42-7119-46f9-b18b-692347fcebc0 for lustre-MDT0000 00000020:00000080:0.0:1787784872.919866:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951c2ce3000 for lustre-MDT0000 00000020:00000080:0.0:1787784872.919872:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c2728000 for lustre-MDT0000 00000020:00000080:0.0:1787784872.919875:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951cfe45000 for lustre-MDT0000 00000001:00100000:3.0:1787784872.920594:0:19429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787784872.920600:0:19429:0:(genops.c:885:class_export_put()) final put ffff8950c2642800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787784872.920617:0:19429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 41f7da42-7119-46f9-b18b-692347fcebc0 00000020:00000080:3.0:1787784872.920620:0:19429:0:(genops.c:885:class_export_put()) final put ffff8951ff02e800/41f7da42-7119-46f9-b18b-692347fcebc0 00000020:00000080:0.0:1787784872.920734:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c2642800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787784872.920803:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951ff02e800/41f7da42-7119-46f9-b18b-692347fcebc0 for lustre-OST0001 00000020:00000080:0.0:1787784872.920821:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c2646800 for lustre-OST0001 00000020:00000080:0.0:1787784872.920825:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951ff028800 for lustre-OST0001 00000001:00100000:0.0:1787784872.921336:0:17840:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787784872.921424:0:17840:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1787784872.921429:0:17840:0:(genops.c:885:class_export_put()) final put ffff8951efed9800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787784872.921548:0:17840:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e18bf9c7-fc9c-4760-9682-7ca1091799a6 00000001:00080000:0.0:1787784872.921555:0:17840:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1787784872.921558:0:17840:0:(genops.c:885:class_export_put()) final put ffff8950c272d800/e18bf9c7-fc9c-4760-9682-7ca1091799a6 00000020:00000080:3.0:1787784872.923211:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8951efed9800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1787784872.923516:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951c85a5000 for lustre-MDT0001 00010000:00010000:2.0:1787784872.923717:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784872.923723:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787784872.924146:0:17840:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 41f7da42-7119-46f9-b18b-692347fcebc0 00000001:00080000:0.0:1787784872.924158:0:17840:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1787784872.924163:0:17840:0:(genops.c:885:class_export_put()) final put ffff8951cfe40800/41f7da42-7119-46f9-b18b-692347fcebc0 00000020:00000080:2.0:1787784872.924415:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c272d800/e18bf9c7-fc9c-4760-9682-7ca1091799a6 for lustre-MDT0001 00000020:00000080:2.0:1787784872.924604:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c272e000 for lustre-MDT0001 00000020:00000080:2.0:1787784872.924790:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951cfe40800/41f7da42-7119-46f9-b18b-692347fcebc0 for lustre-MDT0001 00000020:00000080:2.0:1787784872.924817:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951ff02a000 for lustre-MDT0001 00010000:00010000:1.0:1787784872.927242:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784872.927252:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787784872.945435:0:20681:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8951cfef19b8) has no exports 00000020:00000080:2.0:1787784873.068851:0:20681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9deea 00000020:00000080:2.0:1787784873.068872:0:20681:0:(genops.c:885:class_export_put()) final put ffff8951c642b800/lustre-QMT0000_UUID 00000020:01000000:2.0:1787784873.068897:0:20681:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787784873.069106:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8951c642b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1787784873.069131:0:20681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784873.069141:0:20681:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787784873.069146:0:20681:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8950c20cb370) has no exports 00010000:00010000:0.0:1787784873.069803:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787784873.074299:0:20681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9dee3 00000020:00000080:3.0:1787784873.074319:0:20681:0:(genops.c:885:class_export_put()) final put ffff8951eff29800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787784873.082723:0:20681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784873.082744:0:20681:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787784873.082751:0:20681:0:(genops.c:885:class_export_put()) final put ffff8951eff2c800/lustre-QMT0000_UUID 00000020:00000080:3.0:1787784873.082755:0:20681:0:(genops.c:844:class_export_destroy()) destroying export ffff8951eff2c800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787784873.082762:0:20681:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1787784873.086700:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8951eff29800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787784873.087018:0:20681:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8950c3086780 - data ffff8950c1d05d80/ffff8950c22a8c00 00000020:01000000:3.0:1787784873.087177:0:20681:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8951c3958480 - data ffff8951e0ef9510/ffff8951f474e800 00000001:00000004:3.0:1787784873.106452:0:20681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:2.0:1787784873.153670:0:20681:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787784873.153679:0:20681:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787784873.153696:0:20681:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8951c1218b40 x1874627750234624/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787784882 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784873.153728:0:20681:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787784873.159415:0:20681:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787784873.159426:0:20681:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1787784873.159527:0:20681:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787784873.159548:0:20681:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787784873.160192:0:17131:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787784873.160197:0:17131:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1787784873.160210:0:17131:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1787784873.161048:0:20681:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787784873.161054:0:20681:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1787784873.161067:0:20681:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787784873.161069:0:20681:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787784873.161619:0:17133:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787784873.161624:0:17133:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:3.0:1787784873.161633:0:17133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1787784873.163404:0:20681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9deb2 00000020:00000080:2.0:1787784873.163417:0:20681:0:(genops.c:885:class_export_put()) final put ffff8951ebd63000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787784873.164099:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8951ebd63000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787784873.165673:0:20681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9dec7 00000020:00000080:2.0:1787784873.165685:0:20681:0:(genops.c:885:class_export_put()) final put ffff8951ebd67800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787784873.165700:0:20681:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787784873.165706:0:20681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787784873.165714:0:20681:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787784873.165718:0:20681:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8951cfef3370) has no exports 00000004:01000000:2.0:1787784873.165910:0:20681:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787784873.165918:0:20681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9df29 00000020:00000080:2.0:1787784873.165922:0:20681:0:(genops.c:885:class_export_put()) final put ffff8951fa97f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787784873.165926:0:20681:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787784873.165929:0:20681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787784873.165934:0:20681:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787784873.165936:0:20681:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff895201d08000) has no exports 00000020:00000080:2.0:1787784873.165942:0:20681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9df22 00000020:00000080:2.0:1787784873.165946:0:20681:0:(genops.c:885:class_export_put()) final put ffff8951c323d000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787784873.166730:0:20681:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787784873.166736:0:20681:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787784873.166740:0:20681:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1787784873.166745:0:20681:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787784873.166747:0:20681:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787784873.166798:0:20681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784873.166803:0:20681:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787784873.166808:0:20681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9df14 00000020:00000080:2.0:1787784873.166814:0:20681:0:(genops.c:885:class_export_put()) final put ffff8951fa97c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787784873.166818:0:20681:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787784873.166821:0:20681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787784873.166835:0:20681:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787784873.166838:0:20681:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8950c25b19b8) has no exports 00000020:00000080:2.0:1787784873.166843:0:20681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9df0d 00000020:00000080:2.0:1787784873.166846:0:20681:0:(genops.c:885:class_export_put()) final put ffff8951fa97d800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787784873.167175:0:20681:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787784873.167179:0:20681:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787784873.167181:0:20681:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1787784873.167185:0:20681:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787784873.167186:0:20681:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787784873.167207:0:20681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784873.167211:0:20681:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1787784873.167231:0:20681:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1787784873.167235:0:20681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9deff 00000020:00000080:2.0:1787784873.167239:0:20681:0:(genops.c:885:class_export_put()) final put ffff8951fa97d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787784873.167242:0:20681:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1787784873.167246:0:20681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787784873.167248:0:20681:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787784873.167251:0:20681:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8950c25b0000) has no exports 00000020:00000080:2.0:1787784873.167254:0:20681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9def8 00000020:00000080:2.0:1787784873.167257:0:20681:0:(genops.c:885:class_export_put()) final put ffff8951eff2d800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787784873.168008:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8951ebd67800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1787784873.168019:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fa97f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787784873.168024:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8951c323d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787784873.168030:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951c3238800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787784873.168036:0:37:0:(genops.c:885:class_export_put()) final put ffff8951fa979800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787784873.168039:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fa979800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787784873.168043:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787784873.168160:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fa97c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787784873.168166:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fa97d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787784873.168169:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951c642d800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787784873.168173:0:37:0:(genops.c:885:class_export_put()) final put ffff8951fa97c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787784873.168184:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fa97c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787784873.168187:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787784873.168217:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fa97d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787784873.168232:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8951eff2d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787784873.169817:0:20681:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1787784873.169825:0:20681:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787784873.169828:0:20681:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787784873.169835:0:20681:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787784873.169881:0:20681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784873.169892:0:20681:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787784873.169935:0:20681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784873.169940:0:20681:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787784873.169944:0:20681:0:(genops.c:885:class_export_put()) final put ffff8950c34fc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787784873.169948:0:20681:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c34fc000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787784873.169954:0:20681:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787784873.170048:0:20681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9dece 00000020:00000080:2.0:1787784873.170064:0:20681:0:(genops.c:885:class_export_put()) final put ffff8951ebd64800/lustre-MDD0000_UUID 00000020:01000000:2.0:1787784873.170069:0:20681:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787784873.170072:0:20681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787784873.170077:0:20681:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787784873.170080:0:20681:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8951f02dcd28) has no exports 00000020:00000080:0.0:1787784873.170349:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951eff2a800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787784873.170358:0:37:0:(genops.c:885:class_export_put()) final put ffff8951c6428000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787784873.170361:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8951c6428000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1787784873.170365:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787784873.170414:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8951ebd64800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787784873.171936:0:20681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784873.171949:0:20681:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787784873.171954:0:20681:0:(genops.c:885:class_export_put()) final put ffff8951ebd67000/lustre-MDD0000_UUID 00000020:00000080:2.0:1787784873.171957:0:20681:0:(genops.c:844:class_export_destroy()) destroying export ffff8951ebd67000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787784873.171965:0:20681:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1787784873.172033:0:20681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9ded5 00000020:00000080:2.0:1787784873.172040:0:20681:0:(genops.c:885:class_export_put()) final put ffff8951ebd65800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787784873.172067:0:20681:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951fb22c000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787784873.172071:0:20681:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951fb22c000 3 00000020:01000004:2.0:1787784873.172074:0:20681:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8951fb22c000 from lustre-MDT0000 00000020:00000080:2.0:1787784873.172105:0:20681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784873.172109:0:20681:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787784873.172112:0:20681:0:(genops.c:885:class_export_put()) final put ffff8951ebd65000/lustre-MDT0000_UUID 00000020:00000080:2.0:1787784873.172114:0:20681:0:(genops.c:844:class_export_destroy()) destroying export ffff8951ebd65000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787784873.172121:0:20681:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787784873.172158:0:20681:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1787784873.172163:0:20681:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787784873.172166:0:20681:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787784873.172169:0:20681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787784873.172172:0:20681:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787784873.172179:0:20681:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8951fb22b800 a45ddeb3-718a-48eb-8507-e0c94319fca6 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787784873.172185:0:20681:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8950c25b4d28) has exports, disconnecting them 00000020:00080000:2.0:1787784873.172189:0:20681:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8951fb22b800), last request at 1787784773 00000020:00000080:2.0:1787784873.172204:0:20681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9de7a 00000020:00010000:2.0:1787784873.172208:0:20681:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8951fb22b800: total 1 00000100:00080000:2.0:1787784873.172212:0:20681:0:(import.c:65:import_set_state_nolock()) ffff8951fb22e000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787784873.172242:0:20681:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8951fb22b800): rc 0 00000020:00080000:2.0:1787784873.172256:0:20681:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8950c25b4d28) has no exports 00000020:00010000:2.0:1787784873.172272:0:17095:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8951fb22b800: total 1 00010000:00010000:2.0:1787784873.172275:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784873.172298:0:17095:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8951fb22b800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1787784873.172330:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c3713800/0x88ace7295d9df99 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9df92 expref: 14 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784873.172363:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c3713600/0x88ace7295d9e239 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9e232 expref: 13 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784873.172374:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c0031800/0x88ace7295d9e423 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9e41c expref: 12 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784873.172384:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1629e00/0x88ace7295d9e105 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9e0fe expref: 11 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784873.172395:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df602400/0x88ace7295d9e431 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9e42a expref: 10 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784873.172405:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c4183800/0x88ace7295d9e056 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9e04f expref: 9 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784873.172416:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c3712a00/0x88ace7295d9dfa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9dfa0 expref: 8 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784873.172431:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c0031400/0x88ace7295d9e43f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9e438 expref: 7 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784873.172456:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c3712e00/0x88ace7295d9dfb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9dfae expref: 6 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784873.172466:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df603200/0x88ace7295d9e263 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9e25c expref: 5 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784873.172485:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df602600/0x88ace7295d9de88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9de81 expref: 4 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784873.172497:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c3713c00/0x88ace7295d9e2a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9e29b expref: 3 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784873.172510:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8950c3713a00/0x88ace7295d9e0db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88ace7295d9e0d4 expref: 2 pid: 17100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784873.172520:0:17095:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8951fb22b800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1787784873.172536:0:17095:0:(genops.c:885:class_export_put()) final put ffff8951fb22b800/a45ddeb3-718a-48eb-8507-e0c94319fca6 00010000:00010000:2.0:1787784873.172542:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784873.172543:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784873.172545:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784873.172935:0:17100:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8951fb091c00:17100] 0 exiting: rc = 1 00000100:00100000:0.0:1787784873.173038:0:17101:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8950c3452600:17101] 1 exiting: rc = 0 00000020:00000080:0.0:1787784873.173077:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8951ebd65800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787784873.173086:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fb22b800/a45ddeb3-718a-48eb-8507-e0c94319fca6 for MGS 00000020:00000080:0.0:1787784873.173116:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951fb22e000 for MGS 00000100:00100000:2.0:1787784873.175305:0:17102:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8951fb29b600:17102] 2 exiting: rc = 0 00000100:00100000:0.0:1787784873.175616:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175627:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175633:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175640:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175646:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175652:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175658:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175664:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175671:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175677:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175683:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175690:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175696:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175705:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175711:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175716:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175739:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175745:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175751:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175756:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175761:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175796:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175802:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175807:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175812:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175818:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175823:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175828:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175834:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175840:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175845:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175851:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175856:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175861:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175867:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175873:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175879:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175884:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175889:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175894:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175899:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175905:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175909:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175915:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175920:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175926:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175932:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175938:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175942:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175948:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175952:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175965:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175970:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175975:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175980:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175985:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175990:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.175996:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.176001:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.176006:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.176012:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.176017:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.176023:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784873.176028:0:20681:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1787784873.177982:0:20681:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8951fab48240 - data ffff8951f083f870/ffff8950c1bf5000 00000020:01000000:0.0:1787784873.178135:0:20681:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8950c30f64e0 - data ffff8951e0fccca8/ffff8951fd37c000 00000020:00000080:0.0:1787784873.179107:0:20681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9de5e 00000020:00000080:0.0:1787784873.179119:0:20681:0:(genops.c:885:class_export_put()) final put ffff8951ff5cf000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787784873.179147:0:20681:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951fb22c000 from MGS, refs=2 00000020:01000004:0.0:1787784873.179151:0:20681:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951fb22c000 2 00000020:01000004:0.0:1787784873.179153:0:20681:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8951fb22c000 from MGS 00000020:00000080:0.0:1787784873.179174:0:20681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784873.179180:0:20681:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787784873.179183:0:20681:0:(genops.c:885:class_export_put()) final put ffff8951ff5cb800/MGS 00000020:00000080:0.0:1787784873.179186:0:20681:0:(genops.c:844:class_export_destroy()) destroying export ffff8951ff5cb800/MGS for MGS 00000020:01000000:0.0:1787784873.179192:0:20681:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:2.0:1787784873.179205:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951ff5cf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787784873.179271:0:20681:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787784873.179275:0:20681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787784873.179280:0:20681:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787784873.179287:0:20681:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8951fa90e000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787784873.179292:0:20681:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff895201d0b370) has exports, disconnecting them 00000020:00080000:0.0:1787784873.179297:0:20681:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8951fa90e000), last request at 1787784774 00000020:00000080:0.0:1787784873.179300:0:20681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9df61 00000020:00080000:0.0:1787784873.179323:0:20681:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8951fa90e000): rc 0 00000020:00000080:0.0:1787784873.179328:0:20681:0:(genops.c:885:class_export_put()) final put ffff8951fa90e000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787784873.187592:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fa90e000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787784873.250313:0:20681:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787784873.250324:0:20681:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787784873.250329:0:20681:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787784873.250338:0:20681:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787784873.250373:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951fa908800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787784873.250575:0:20681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784873.250585:0:20681:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787784873.250591:0:20681:0:(genops.c:885:class_export_put()) final put ffff8951d1d57000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787784873.250595:0:20681:0:(genops.c:844:class_export_destroy()) destroying export ffff8951d1d57000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787784873.250605:0:20681:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787784873.250837:0:20681:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951fb22c000 1 00000020:00000080:2.0:1787784873.250852:0:20681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9de50 00000020:00000080:2.0:1787784873.250859:0:20681:0:(genops.c:885:class_export_put()) final put ffff8951ff5ca800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787784873.250867:0:20681:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787784873.250875:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951ff5ca800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787784873.250884:0:20681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787784873.250889:0:20681:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787784873.250893:0:20681:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8950c20c99b8) has no exports 00000020:00000080:2.0:1787784873.608197:0:20681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784873.608210:0:20681:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787784873.608216:0:20681:0:(genops.c:885:class_export_put()) final put ffff8951fb22a000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787784873.608221:0:20681:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fb22a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787784873.608591:0:20681:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787784873.608731:0:20681:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8951fb22e800 00000020:02000400:2.0:1787784873.608986:0:20681:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1787784874.119391:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784875.142267:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784875.142289:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750235008:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784875.142355:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784875.142430:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750235008 00000100:00100000:1.0:1787784875.142438:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750235008 00000100:00100000:1.0:1787784875.142510:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787784875.142538:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c121b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750235008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787784875.142578:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787784875.142621:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c121b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750235008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784875.142628:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1787784875.142732:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784875.142790:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750235008:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787784875.143718:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784875.655663:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c1219e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750235136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787784875.655744:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784875.655865:0:17623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750235136 00000100:00100000:3.0:1787784875.655872:0:17623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750235136 00000100:00100000:3.0:1787784875.655911:0:17623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787784875.655918:0:17623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c121ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1874627750235136:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1787784875.655926:0:17623:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787784875.655965:0:17623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c121ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1874627750235136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (222us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787784875.655971:0:17623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:02020000:3.0:1787784875.656012:0:3646:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1787784875.664370:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787784875.664380:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8951cfe93800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787784875.664391:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787784875.680296:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8951cfe93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787784875.680306:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 528 00000100:00080000:3.0:1787784875.680316:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8951cfe93800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784875.684710:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951ff4543c0 x1874627750235264/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787784875.685899:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff4543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750235264:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787784875.685969:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784875.688816:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750235264 00000100:00100000:0.0:1787784875.688830:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750235264 00000100:00100000:0.0:1787784875.688881:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787784875.688890:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c1218b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874627750235264:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1787784875.688913:0:17113:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787784875.714912:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c1218b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874627750235264:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 26017us (28937us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787784875.714928:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1787784875.714989:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951cfe93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787784875.714995:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787784875.714999:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff4543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750235264:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:2.0:1787784876.165964:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787784877.189377:0:20881:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000100:00080000:3.0:1787784877.195140:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787784877.195147:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787784877.195151:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8951cfe93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787784877.195160:0:15021:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 615 00000100:00080000:3.0:1787784877.195165:0:15021:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787784877.195172:0:15021:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8951cfe93800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1787784877.195196:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951c562b840 x1874627750235520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787784877.195279:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c1219680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a45ddeb3-718a-48eb-8507-e0c94319fca6:3647:1874627750235392:0@lo:400:kworker.0 00000400:00000100:3.0:1787784877.195328:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874627750235392 offset 0 length 224: 4 00000100:00100000:3.0:1787784877.195372:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5629a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750236032:0@lo:400:kworker.0 00000100:00100000:3.0:1787784877.195404:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784877.195430:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787784877.195435:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750235904:0@lo:400:kworker.0 00000100:00100000:3.0:1787784877.195454:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784877.195467:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750236416:0@lo:400:kworker.0 00000100:00100000:3.0:1787784877.195498:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784877.195553:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c56292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750235648:0@lo:400:kworker.0 00000100:00100000:3.0:1787784877.195583:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784877.195600:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c56283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750236160:0@lo:400:kworker.0 00000100:00100000:3.0:1787784877.195632:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784877.195653:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787784877.195658:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5629680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750235776:0@lo:400:kworker.0 00000100:00100000:3.0:1787784877.195679:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784877.195695:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750236288:0@lo:400:kworker.0 00000100:00100000:3.0:1787784877.195714:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784877.195750:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750236032 00000100:00100000:3.0:1787784877.195759:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750236032 00000100:00100000:3.0:1787784877.195816:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750235904 00000100:00100000:3.0:1787784877.195819:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750235904 00000100:00100000:3.0:1787784877.195828:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750236416 00000100:00100000:3.0:1787784877.195830:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750236416 00000100:00100000:3.0:1787784877.195864:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750236160 00000100:00100000:3.0:1787784877.195867:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750236160 00000100:00100000:3.0:1787784877.195881:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750236288 00000100:00100000:3.0:1787784877.195883:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750236288 00000100:00100000:3.0:1787784877.195895:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787784877.195904:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750236416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784877.196228:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750236416:12345-0@lo:400:kworker.0 Request processed in 323us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784877.196236:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787784877.196257:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787784877.196263:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750236160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784877.196295:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750236160:12345-0@lo:400:kworker.0 Request processed in 33us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784877.196313:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787784877.196326:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787784877.196331:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874627750236032:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787784877.196336:0:18636:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787784877.196363:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874627750236032:12345-0@lo:400:kworker.0 Request processed in 31us (958us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787784877.196368:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787784877.196381:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787784877.196384:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874627750235904:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787784877.196388:0:18636:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787784877.196410:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874627750235904:12345-0@lo:400:kworker.0 Request processed in 24us (955us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787784877.196415:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787784877.196428:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787784877.196432:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1874627750236288:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787784877.196435:0:18636:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787784877.196456:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1874627750236288:12345-0@lo:400:kworker.0 Request processed in 23us (741us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787784877.196461:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787784877.196492:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787784877.196523:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787784877.196528:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8950c360c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787784877.196541:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1787784877.201810:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750235520:0@lo:38:kworker.0 00000100:00100000:0.0:1787784877.201886:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784877.201978:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750235648 00000100:00100000:0.0:1787784877.201986:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750235648 00000100:00100000:0.0:1787784877.202040:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750235776 00000100:00100000:0.0:1787784877.202045:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750235776 00000100:00100000:0.0:1787784877.202068:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787784877.202544:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750235648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784877.202606:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750235648:12345-0@lo:400:kworker.0 Request processed in 529us (7021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784877.202613:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787784877.202643:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787784877.202650:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750235776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784877.202699:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750235776:12345-0@lo:400:kworker.0 Request processed in 50us (7018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784877.202706:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787784877.202734:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750235520 00000100:00100000:0.0:1787784877.202738:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750235520 00000100:00100000:0.0:1787784877.202759:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787784877.202764:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874627750235520:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787784877.202806:0:17112:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787784877.202841:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874627750235520:12345-0@lo:38:kworker.0 Request processed in 76us (955us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787784877.202847:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1787784877.202888:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951cfe93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787784877.202894:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787784877.202897:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750235520:0@lo:38:kworker.0 00000100:00080000:0.0:1787784877.203055:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787784877.203061:0:17103:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784877.204270:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784877.204285:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750236544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784877.204330:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784877.204370:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750236544 00000100:00100000:0.0:1787784877.204374:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750236544 00000100:00100000:0.0:1787784877.204406:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787784877.204414:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb2543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750236544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787784877.204439:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787784877.205011:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb2543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750236544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784877.205035:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787784877.206253:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750236544:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787784877.209847:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787784877.209939:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787784877.209945:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8951efed9000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787784877.209950:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787784877.209955:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8951efed9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787784877.209960:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 529 00000100:00080000:2.0:1787784877.209969:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8951efed9000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784877.210000:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fbe5b840 x1874627750236672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787784877.210024:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750235904:0@lo:400:kworker.0 00010000:00080000:2.0:1787784877.210043:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8951fd7c30c0 x1874627750236416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784877.210067:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750236416:0@lo:400:kworker.0 00000100:00080000:2.0:1787784877.210080:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787784877.210083:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8951cfe41000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787784877.210085:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787784877.210088:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8951cfe41000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787784877.210091:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 544 00000100:00080000:2.0:1787784877.210095:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8951cfe41000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784877.210107:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fbe59680 x1874627750236800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787784877.210116:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5629a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750236032:0@lo:400:kworker.0 00000100:00100000:0.0:1787784877.212017:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874627750236672:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787784877.212170:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784877.212460:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874627750236800:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787784877.213226:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784877.215695:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750236672 00000100:00100000:2.0:1787784877.215709:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750236672 00000100:00100000:2.0:1787784877.215752:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750236800 00000100:00100000:2.0:1787784877.215755:0:18636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750236800 00000100:00100000:2.0:1787784877.215802:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787784877.215811:0:18636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb256580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1874627750236672:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1787784877.215834:0:18636:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787784877.215847:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787784877.215853:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb2570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874627750236800:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1787784877.215863:0:17107:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787784877.216588:0:18636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb256580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1874627750236672:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 774us (4416us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787784877.216599:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787784877.217640:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951efed9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784877.217652:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787784877.217657:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874627750236672:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787784877.218337:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb2570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874627750236800:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 2479us (5110us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787784877.218348:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1787784877.223609:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951cfe41000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784877.223678:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787784877.223684:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874627750236800:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1787784877.226010:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8950c360c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787784877.226022:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 566 00000100:00080000:3.0:1787784877.226049:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8950c360c000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1787784877.226162:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fd7c0f00 x1874627750236928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787784877.226271:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874627750236928:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787784877.226343:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784877.226442:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1874627750236288:0@lo:400:kworker.0 00000100:00100000:3.0:1787784877.226471:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c56292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750235648:0@lo:400:kworker.0 00010000:00080000:3.0:1787784877.226494:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8951c56283c0 x1874627750236160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784877.226504:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c56283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750236160:0@lo:400:kworker.0 00000100:00100000:3.0:1787784877.226546:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5629680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750235776:0@lo:400:kworker.0 00000100:00100000:2.0:1787784877.226697:0:19997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750236928 00000100:00100000:2.0:1787784877.226703:0:19997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750236928 00000100:00100000:2.0:1787784877.226804:0:19997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787784877.226811:0:19997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1874627750236928:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1787784877.226840:0:19997:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787784877.227333:0:19997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1874627750236928:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 519us (987us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787784877.227341:0:19997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1787784877.227414:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c360c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787784877.227420:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787784877.227423:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874627750236928:0@lo:38:ptlrpcd_00_00.0 00000020:01000004:3.0:1787784877.228359:0:20881:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1787784877.228412:0:20881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9e04f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e056 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784877.228425:0:20881:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9e04f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e056 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784877.228432:0:20881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9e04f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9e056 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784877.228438:0:20881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9e04f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9e056 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784877.228464:0:20881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787784877.228470:0:20881:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787784877.228502:0:20881:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787784877.228506:0:20881:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787784877.228523:0:20881:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787784877.228539:0:20881:0:(import.c:65:import_set_state_nolock()) ffff8951efed9000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787784877.228544:0:20881:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787784877.228546:0:20881:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787784877.228549:0:20881:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787784877.229302:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784877.229311:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9e04f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9e056 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.229321:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629000 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784877.229325:0:17096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9e04f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9e056 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.229334:0:17096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9e04f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9e056 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784877.229348:0:17096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9e04f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9e056 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784877.229354:0:17096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787784877.229357:0:17096:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787784877.229359:0:17096:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787784877.229395:0:17096:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9e04f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9e056 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.229401:0:17096:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787784877.229455:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb2561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750237056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784877.229516:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784877.229566:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750237056 00000100:00100000:1.0:1787784877.229572:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750237056 00000100:00100000:1.0:1787784877.229613:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787784877.229634:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1874627750237056:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787784877.229640:0:17094:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787784877 with bad export cookie 615531290625171066 00010000:00010000:3.0:1787784877.235075:0:20881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182000/0x88ace7295d9dfae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9dfb5 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784877.235106:0:20881:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182000/0x88ace7295d9dfae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9dfb5 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784877.235115:0:20881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182000/0x88ace7295d9dfae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9dfb5 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784877.235122:0:20881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8950c4182000/0x88ace7295d9dfae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9dfb5 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784877.235145:0:20881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784877.235150:0:20881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9e29b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e2a2 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784877.235156:0:20881:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9e29b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e2a2 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784877.235162:0:20881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9e29b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9e2a2 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784877.235168:0:20881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9e29b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9e2a2 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784877.235209:0:20881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787784877.235216:0:20881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d34200/0x88ace7295d9e438 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e43f expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784877.235223:0:20881:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d34200/0x88ace7295d9e438 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e43f expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784877.235228:0:20881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d34200/0x88ace7295d9e438 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9e43f expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784877.235234:0:20881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8951e1d34200/0x88ace7295d9e438 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9e43f expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784877.235241:0:20881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787784877.235246:0:20881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9dfa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9dfa7 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784877.235252:0:20881:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9dfa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9dfa7 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784877.235257:0:20881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9dfa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9dfa7 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784877.235263:0:20881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9dfa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9dfa7 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784877.235270:0:20881:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1787784877.235273:0:20881:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1787784877.235310:0:20881:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1787784877.235315:0:20881:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1787784877.235319:0:20881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784877.235325:0:20881:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1787784877.235333:0:20881:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8951c41de000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787784877.235339:0:20881:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8950c2643800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787784877.235343:0:20881:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8951fb3899b8) has exports, disconnecting them 00000020:00080000:3.0:1787784877.235347:0:20881:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8951c41de000), last request at 1787784877 00000020:00000080:3.0:1787784877.235354:0:20881:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e28d 00000100:00080000:3.0:1787784877.235372:0:20881:0:(import.c:65:import_set_state_nolock()) ffff8951c41db800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787784877.235424:0:20881:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8951c41de000): rc 0 00000020:00000080:3.0:1787784877.235427:0:20881:0:(genops.c:885:class_export_put()) final put ffff8951c41de000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1787784877.235438:0:20881:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8950c2643800), last request at 1787784877 00000020:00000080:3.0:1787784877.235441:0:20881:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e12f 00000100:00080000:3.0:1787784877.235446:0:20881:0:(import.c:65:import_set_state_nolock()) ffff8950c2645800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1787784877.235456:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951c41de000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1787784877.235496:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951c41db800 for lustre-MDT0001 00000020:00080000:3.0:1787784877.235511:0:20881:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8950c2643800): rc 0 00000020:00000080:3.0:1787784877.235513:0:20881:0:(genops.c:885:class_export_put()) final put ffff8950c2643800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1787784877.235522:0:20881:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb77a01673ae0 00000020:00000080:3.0:1787784877.235547:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c2643800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1787784877.235574:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c2645800 for lustre-MDT0001 00000100:00080000:3.0:1787784877.235595:0:20881:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787784877.235605:0:20881:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8951c1219e00 x1874627750235136/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787784891 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784877.235624:0:20881:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787784877.236425:0:20881:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787784877.236432:0:20881:0:(import.c:65:import_set_state_nolock()) ffff8951cfe93800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1787784877.239613:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9e04f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9e056 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.239632:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951d1629000/0x88ace7295d9e04f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9e056 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.239656:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787784877.239661:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8950c4182000/0x88ace7295d9dfae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9dfb5 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.239668:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182000 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784877.239672:0:17096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8950c4182000/0x88ace7295d9dfae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9dfb5 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.239681:0:17096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8950c4182000/0x88ace7295d9dfae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9dfb5 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784877.239688:0:17096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8950c4182000/0x88ace7295d9dfae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9dfb5 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784877.239714:0:17096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787784877.239717:0:17096:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1787784877.239720:0:17096:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1787784877.239758:0:17096:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8950c4182000/0x88ace7295d9dfae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9dfb5 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.239764:0:17096:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784877.239810:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8950c4182000/0x88ace7295d9dfae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9dfb5 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.239817:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8950c4182000/0x88ace7295d9dfae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9dfb5 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.239828:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787784877.239832:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9e29b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9e2a2 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.239837:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712200 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784877.239839:0:17096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9e29b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9e2a2 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.239845:0:17096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9e29b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9e2a2 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784877.239851:0:17096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9e29b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9e2a2 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784877.239855:0:17096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787784877.239857:0:17096:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787784877.239859:0:17096:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787784877.239882:0:17096:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9e29b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9e2a2 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.239888:0:17096:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784877.239905:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9e29b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9e2a2 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.239912:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8950c3712200/0x88ace7295d9e29b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9e2a2 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.239926:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787784877.239930:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951e1d34200/0x88ace7295d9e438 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9e43f expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.239935:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d34200 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784877.239938:0:17096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d34200/0x88ace7295d9e438 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9e43f expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.239945:0:17096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951e1d34200/0x88ace7295d9e438 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9e43f expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784877.239952:0:17096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d34200/0x88ace7295d9e438 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9e43f expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784877.239957:0:17096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787784877.239959:0:17096:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787784877.239962:0:17096:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787784877.239974:0:17096:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951e1d34200/0x88ace7295d9e438 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9e43f expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.239980:0:17096:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784877.239985:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951e1d34200/0x88ace7295d9e438 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9e43f expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.239997:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951e1d34200/0x88ace7295d9e438 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9e43f expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.240006:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784877.240010:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9dfa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9dfa7 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.240016:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628a00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784877.240019:0:17096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9dfa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9dfa7 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.240026:0:17096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9dfa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9dfa7 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784877.240032:0:17096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9dfa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9dfa7 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784877.240038:0:17096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787784877.240040:0:17096:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787784877.240042:0:17096:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787784877.240054:0:17096:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9dfa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9dfa7 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.240059:0:17096:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784877.240066:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9dfa0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9dfa7 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.240072:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951d1628a00/0x88ace7295d9dfa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x88ace7295d9dfa7 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784877.240094:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784877.240096:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784877.240098:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784877.240130:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb257840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a45ddeb3-718a-48eb-8507-e0c94319fca6:3646:1874627750237312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784877.240207:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784877.240263:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c1219e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750235136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787784877.240289:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784877.240294:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb255680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a45ddeb3-718a-48eb-8507-e0c94319fca6:3646:1874627750237440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784877.240316:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784877.240348:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750237312 00000100:00100000:0.0:1787784877.240355:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750237312 00000100:00100000:0.0:1787784877.240383:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750237440 00000100:00100000:0.0:1787784877.240385:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750237440 00000100:00100000:0.0:1787784877.240397:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787784877.240404:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb257c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3646:x1874627750237312:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787784877.240411:0:17092:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787784877 with bad export cookie 615531290625171066 00000100:00100000:0.0:1787784877.240458:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb257c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3646:x1874627750237312:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (250us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787784877.240465:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787784877.240482:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787784877.240486:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb254b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3646:x1874627750237440:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787784877.240490:0:17092:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787784877 with bad export cookie 615531290625171066 00000100:00100000:0.0:1787784877.240515:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb254b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3646:x1874627750237440:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (198us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787784877.240521:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1787784877.240573:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.141@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787784877.240577:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8950c41f8800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787784877.240581:0:3646:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.141@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1787784877.241609:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784877.241616:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784877.244466:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1874627750237056:12345-0@lo:103:ldlm_bl.0 Request processed in 14827us (14946us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787784877.244480:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787784877.258720:0:3646:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.141@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787784877.258727:0:3646:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787784877.258736:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8951c1219680 x1874627750235392/t0(0) o400->MGC192.168.202.141@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787784893 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784877.259486:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8951fb2561c0 x1874627750237056/t0(0) o103->MGC192.168.202.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787784893 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784877.259499:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8951fb257840 x1874627750237312/t0(0) o103->MGC192.168.202.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787784893 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784877.259509:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8951fb255680 x1874627750237440/t0(0) o103->MGC192.168.202.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787784893 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787784877.259517:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787784877.259520:0:3646:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787784877.259521:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787784877.259690:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb254f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a45ddeb3-718a-48eb-8507-e0c94319fca6:0:1874627750237184:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787784877.259811:0:20881:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787784877.259815:0:20881:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1787784877.259830:0:20881:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787784877.259898:0:20881:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787784877.259941:0:20881:0:(import.c:65:import_set_state_nolock()) ffff8951c2cc4800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787784877.259958:0:20881:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787784877.259961:0:20881:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1787784877.259970:0:20881:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787784877.260028:0:20881:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787784877.260038:0:20881:0:(import.c:65:import_set_state_nolock()) ffff8951cfe44000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787784877.260077:0:20881:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8951fb3899b8) has no exports 00000100:00100000:2.0:1787784877.260359:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb256940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:0:1874627750237568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784877.260401:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb2561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a45ddeb3-718a-48eb-8507-e0c94319fca6:3644:1874627750237056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784877.260557:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c1219680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a45ddeb3-718a-48eb-8507-e0c94319fca6:3647:1874627750235392:0@lo:400:kworker.0 00000100:00100000:2.0:1787784877.260687:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750237696:0@lo:9:umount.0 00000100:00100000:2.0:1787784877.260754:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784877.260823:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750237824:0@lo:9:umount.0 00000100:00100000:2.0:1787784877.260845:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784877.260987:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750237696 00000100:00100000:3.0:1787784877.260995:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750237696 00000100:00100000:3.0:1787784877.261038:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750237824 00000100:00100000:3.0:1787784877.261041:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750237824 00000100:00100000:3.0:1787784877.261067:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787784877.261076:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbe5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874627750237696:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787784877.262405:0:18612:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e159 00000100:00080000:3.0:1787784877.262422:0:18612:0:(import.c:65:import_set_state_nolock()) ffff8950c2641000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787784877.262473:0:18612:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1787784877.262640:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbe5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3643:x1874627750237696:12345-0@lo:9:umount.0 Request processed in 1563us (1883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784877.262651:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787784877.262678:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787784877.262690:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbe5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1874627750237824:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787784877.262707:0:18612:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e2be 00000100:00080000:3.0:1787784877.262714:0:18612:0:(import.c:65:import_set_state_nolock()) ffff8950c2643000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787784877.262749:0:18612:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1787784877.262850:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbe5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3643:x1874627750237824:12345-0@lo:9:umount.0 Request processed in 164us (2004us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784877.262858:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1787784877.262885:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787784877.262928:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951c2cc4800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787784877.262940:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787784877.262942:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787784877.262946:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750237696:0@lo:9:umount.0 00000100:00080000:3.0:1787784877.262959:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951cfe44000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787784877.262966:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787784877.262967:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787784877.262970:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750237824:0@lo:9:umount.0 00000100:00080000:0.0:1787784877.263944:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8950c41f8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784877.263951:0:3646:0:(import.c:510:import_select_connection()) MGC192.168.202.141@tcp: connect to NID 0@lo last attempt 513 00000100:00080000:0.0:1787784877.263958:0:3646:0:(import.c:624:import_select_connection()) MGC192.168.202.141@tcp: import ffff8950c41f8800 using connection 192.168.202.141@tcp/0@lo 00010000:00010000:0.0:1787784877.263967:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784877.263996:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fb2552c0 x1874627750237952/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787784877.264034:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb257840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a45ddeb3-718a-48eb-8507-e0c94319fca6:3646:1874627750237312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784877.264049:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb255680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a45ddeb3-718a-48eb-8507-e0c94319fca6:3646:1874627750237440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784877.264309:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb2552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a45ddeb3-718a-48eb-8507-e0c94319fca6:3643:1874627750237952:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1787784877.264345:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874627750237952 offset 0 length 520: 4 00000020:00080000:2.0:1787784877.274577:0:20881:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8951fb3899b8) has no exports 00000020:01000000:3.0:1787784877.361722:0:20881:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8950c3086360 - data ffff8951f0a83af8/ffff8950c22a8400 00000020:01000000:3.0:1787784877.361929:0:20881:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8951d0707cc0 - data ffff8951e0f6caf8/ffff8951c4529000 00000001:00000004:3.0:1787784877.379825:0:20881:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1787784877.458841:0:20881:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787784877.458850:0:20881:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787784877.458858:0:20881:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787784877.460861:0:20881:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787784877.460868:0:20881:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1787784877.460886:0:20881:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787784877.460888:0:20881:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787784877.461423:0:17848:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787784877.461429:0:17848:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1787784877.461440:0:17848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1787784877.463547:0:20881:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787784877.463555:0:20881:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1787784877.463741:0:20881:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787784877.463745:0:20881:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787784877.464742:0:17850:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787784877.464747:0:17850:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1787784877.464759:0:17850:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1787784877.467049:0:20881:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9dfc3 00000020:00000080:0.0:1787784877.467063:0:20881:0:(genops.c:885:class_export_put()) final put ffff8951cfe43800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787784877.467307:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951cfe43800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787784877.469326:0:20881:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9dfd8 00000020:00000080:1.0:1787784877.469341:0:20881:0:(genops.c:885:class_export_put()) final put ffff8951fa9c7000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787784877.469362:0:20881:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1787784877.469369:0:20881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787784877.469380:0:20881:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787784877.469385:0:20881:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8951fb388000) has no exports 00000004:01000000:1.0:1787784877.469588:0:20881:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787784877.469598:0:20881:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e02c 00000020:00000080:1.0:1787784877.469602:0:20881:0:(genops.c:885:class_export_put()) final put ffff8950c35aa800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787784877.469607:0:20881:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787784877.469610:0:20881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787784877.469624:0:20881:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787784877.469627:0:20881:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8950c20ccd28) has no exports 00000020:00000080:1.0:1787784877.469632:0:20881:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e025 00000020:00000080:1.0:1787784877.469635:0:20881:0:(genops.c:885:class_export_put()) final put ffff8951cfe42800/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1787784877.469997:0:20881:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787784877.470003:0:20881:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787784877.470007:0:20881:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1787784877.470013:0:20881:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787784877.470016:0:20881:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787784877.470048:0:20881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787784877.470054:0:20881:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787784877.470060:0:20881:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e017 00000020:00000080:1.0:1787784877.470064:0:20881:0:(genops.c:885:class_export_put()) final put ffff8950c35a8800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787784877.470081:0:20881:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787784877.470084:0:20881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787784877.470089:0:20881:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787784877.470091:0:20881:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8950c20c8000) has no exports 00000020:00000080:1.0:1787784877.470095:0:20881:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e010 00000020:00000080:1.0:1787784877.470098:0:20881:0:(genops.c:885:class_export_put()) final put ffff8951fa90f800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787784877.470491:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fa9c7000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1787784877.471196:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c35aa800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1787784877.471204:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951cfe42800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787784877.471210:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951cfe44000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1787784877.471217:0:15021:0:(genops.c:885:class_export_put()) final put ffff8950c35af800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787784877.471220:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c35af800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1787784877.471224:0:15021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787784877.471312:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c35a8800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1787784877.471317:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fa90f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787784877.471935:0:20881:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787784877.471941:0:20881:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787784877.471945:0:20881:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1787784877.471951:0:20881:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787784877.471954:0:20881:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787784877.471995:0:20881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787784877.472003:0:20881:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1787784877.472016:0:20881:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787784877.472022:0:20881:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9dffb 00000020:00000080:1.0:1787784877.472028:0:20881:0:(genops.c:885:class_export_put()) final put ffff8951cfe44800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787784877.472032:0:20881:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1787784877.472037:0:20881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787784877.472040:0:20881:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787784877.472044:0:20881:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8951fb38cd28) has no exports 00000020:00000080:1.0:1787784877.472050:0:20881:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9dff4 00000020:00000080:1.0:1787784877.472053:0:20881:0:(genops.c:885:class_export_put()) final put ffff8951cfe97000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787784877.472728:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951c2cc4800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1787784877.472737:0:15021:0:(genops.c:885:class_export_put()) final put ffff8950c259c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787784877.472740:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c259c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1787784877.472746:0:15021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787784877.472842:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951cfe44800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1787784877.472848:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951cfe97000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787784877.474040:0:20881:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1787784877.474047:0:20881:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787784877.474051:0:20881:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787784877.474058:0:20881:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787784877.474106:0:20881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784877.474125:0:20881:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787784877.474158:0:20881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784877.474162:0:20881:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787784877.474166:0:20881:0:(genops.c:885:class_export_put()) final put ffff8951cfe41800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787784877.474169:0:20881:0:(genops.c:844:class_export_destroy()) destroying export ffff8951cfe41800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1787784877.474174:0:20881:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787784877.474445:0:20881:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9dfdf 00000020:00000080:0.0:1787784877.474453:0:20881:0:(genops.c:885:class_export_put()) final put ffff8951fa9c3800/lustre-MDD0001_UUID 00000020:01000000:0.0:1787784877.474458:0:20881:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1787784877.474461:0:20881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787784877.474466:0:20881:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787784877.474469:0:20881:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8951fb38b370) has no exports 00000020:00000080:0.0:1787784877.474489:0:20881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784877.474491:0:20881:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1787784877.474495:0:20881:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9dfe6 00000020:00000080:0.0:1787784877.474498:0:20881:0:(genops.c:885:class_export_put()) final put ffff8951fa9c5800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1787784877.474505:0:20881:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8950c4020000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1787784877.474508:0:20881:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8950c4020000 2 00000020:01000004:0.0:1787784877.474511:0:20881:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8950c4020000 from lustre-MDT0001 00000020:00000080:0.0:1787784877.474527:0:20881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784877.474540:0:20881:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1787784877.474543:0:20881:0:(genops.c:885:class_export_put()) final put ffff8951cfe47000/lustre-MDT0001_UUID 00000020:00000080:0.0:1787784877.474545:0:20881:0:(genops.c:844:class_export_destroy()) destroying export ffff8951cfe47000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1787784877.474552:0:20881:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1787784877.474579:0:20881:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1787784877.474583:0:20881:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1787784877.474585:0:20881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787784877.474587:0:20881:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787784877.474594:0:20881:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8950c35ac000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787784877.474599:0:20881:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff895201d099b8) has exports, disconnecting them 00000020:00080000:0.0:1787784877.474603:0:20881:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8950c35ac000), last request at 1787784788 00000020:00000080:0.0:1787784877.474607:0:20881:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e064 00000020:00080000:0.0:1787784877.474763:0:20881:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8950c35ac000): rc 0 00000020:00000080:0.0:1787784877.474789:0:20881:0:(genops.c:885:class_export_put()) final put ffff8950c35ac000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787784877.475301:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951cfe93800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1787784877.475310:0:15021:0:(genops.c:885:class_export_put()) final put ffff8951cfe45800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787784877.475312:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951cfe45800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1787784877.475329:0:15021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787784877.475509:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fa9c3800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1787784877.475513:0:15021:0:(genops.c:885:class_export_put()) final put ffff8951cfe43000/lustre-MDD0001_UUID 00000020:00000080:2.0:1787784877.475515:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951cfe43000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1787784877.475519:0:15021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1787784877.475755:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8951fa9c5800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787784877.475760:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c35ac000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1787784877.494865:0:20881:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1787784877.494878:0:20881:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787784877.494883:0:20881:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787784877.494890:0:20881:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787784877.494924:0:15021:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951efed9000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787784877.495089:0:20881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784877.495098:0:20881:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1787784877.495103:0:20881:0:(genops.c:885:class_export_put()) final put ffff8950c35af000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1787784877.495107:0:20881:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c35af000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1787784877.495118:0:20881:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1787784877.495218:0:20881:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8950c4020000 1 00000020:00000080:2.0:1787784877.495225:0:20881:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9df8b 00000020:00000080:2.0:1787784877.495233:0:20881:0:(genops.c:885:class_export_put()) final put ffff8950c259f800/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1787784877.495243:0:20881:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1787784877.495251:0:15021:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c259f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787784877.495260:0:20881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787784877.495265:0:20881:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787784877.495269:0:20881:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8950c25b3370) has no exports 00000020:00000080:0.0:1787784877.584262:0:20881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784877.584276:0:20881:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1787784877.584282:0:20881:0:(genops.c:885:class_export_put()) final put ffff8951c642e000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787784877.584296:0:20881:0:(genops.c:844:class_export_destroy()) destroying export ffff8951c642e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1787784877.584306:0:20881:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1787784877.584425:0:20881:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8951c642c000 00000020:01000000:0.0:1787784877.584443:0:20881:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787784877.584447:0:20881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787784877.584451:0:20881:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787784877.584455:0:20881:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8951cfef0000) has no exports 00000100:00100000:0.0:1787784877.584546:0:17107:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8951e1d0d800:17107] 0 exiting: rc = 1 00000100:00100000:3.0:1787784877.584596:0:17109:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8951fb28ba00:17109] 2 exiting: rc = 0 00000100:00100000:3.0:1787784877.584673:0:18636:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8950c316aa00:18636] 3 exiting: rc = 0 00000100:00100000:3.0:1787784877.584889:0:17108:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8951f5018000:17108] 1 exiting: rc = 0 00000100:00100000:2.0:1787784877.585128:0:19997:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8950c19c8a00:19997] 4 exiting: rc = 0 00000100:00100000:0.0:1787784877.586991:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587001:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587007:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587026:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587032:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587038:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587043:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587049:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587055:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587061:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587067:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587072:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587076:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587082:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587086:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587092:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587096:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587102:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587108:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587114:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587119:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587125:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587131:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587137:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587143:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587148:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587173:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587179:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587749:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587757:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.587763:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.589057:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.589067:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.589074:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.589079:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.589085:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.589091:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.589096:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.589100:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.589106:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.589112:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.589117:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.589123:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.589128:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.589134:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.589139:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.589144:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.589149:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.589154:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.589160:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.589165:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.589171:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.589176:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.590123:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.590138:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.590144:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.590168:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.590175:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.590180:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.590368:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.590373:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.590387:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.590393:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.590407:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.608165:0:17111:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8951eff05200:17111] 1 exiting: rc = 0 00000100:00100000:0.0:1787784877.608269:0:17110:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff895201c63600:17110] 0 exiting: rc = 1 00000100:00100000:2.0:1787784877.608656:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608666:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608673:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608691:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608696:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608702:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608707:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608712:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608718:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608723:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608728:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608733:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608738:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608743:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608748:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608753:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608758:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608763:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608787:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608793:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608799:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608804:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608810:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608815:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608821:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608827:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608832:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608837:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608842:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608848:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608854:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608859:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608866:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608871:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608876:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608882:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608887:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608892:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608905:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608910:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608916:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608922:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608927:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608932:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608938:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608945:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608950:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608955:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608960:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608965:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608969:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608974:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608979:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608984:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608989:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608994:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.608999:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.609004:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.609010:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.609015:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.609020:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.609025:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.609030:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.609035:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784877.610287:0:17113:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8951fb29be00:17113] 1 exiting: rc = 0 00000100:00100000:0.0:1787784877.610366:0:17112:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8951fb29b200:17112] 0 exiting: rc = 1 00000100:00100000:0.0:1787784877.610502:0:17623:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8950c19de600:17623] 2 exiting: rc = 0 00000100:00100000:2.0:1787784877.610629:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610636:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610653:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610661:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610667:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610673:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610680:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610686:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610692:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610709:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610715:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610730:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610737:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610742:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610748:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610753:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610757:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610763:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610801:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610809:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610816:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610822:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610829:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610851:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610858:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610865:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610871:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610877:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610883:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610889:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610895:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610901:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610907:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610912:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610917:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610939:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610947:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610953:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610959:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610966:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610971:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610977:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610982:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.610987:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.611014:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.611021:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.611027:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.611047:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.611054:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.611060:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.611066:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.611073:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.611081:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.611087:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.611094:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.611102:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.611108:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.611115:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.611121:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.611144:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.611152:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.611157:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.611163:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.611175:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.622423:0:17115:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8951fb29a200:17115] 1 exiting: rc = 0 00000100:00100000:1.0:1787784877.622658:0:17114:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8951fb29a600:17114] 0 exiting: rc = 1 00000100:00100000:3.0:1787784877.623158:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623166:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623171:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623177:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623253:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623261:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623266:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623271:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623276:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623281:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623286:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623304:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623309:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623313:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623318:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623322:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623327:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623332:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623337:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623341:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623347:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623352:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623356:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623361:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623366:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623371:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623375:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623381:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623386:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623390:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623394:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623399:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623417:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623422:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623427:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623432:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623436:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623441:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623446:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623451:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623455:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623460:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623464:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623469:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623474:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623479:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623492:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623497:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623502:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623507:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623511:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623516:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623520:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623525:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623540:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623545:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623550:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623555:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623560:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623565:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623571:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623575:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623580:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.623585:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784877.624643:0:17116:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8951fb29a000:17116] 0 exiting: rc = 1 00000100:00100000:2.0:1787784877.624924:0:17117:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8951fb29ac00:17117] 1 exiting: rc = 0 00000100:00100000:1.0:1787784877.625015:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625022:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625027:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625032:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625037:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625041:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625047:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625052:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625057:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625063:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625077:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625082:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625086:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625091:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625096:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625101:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625106:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625111:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625115:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625121:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625126:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625132:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625137:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625142:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625148:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625153:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625158:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625163:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625167:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625172:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625178:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625196:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625202:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625207:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625212:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625217:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625223:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625228:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625233:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625239:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625244:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625250:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625255:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625260:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625265:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625279:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625285:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625290:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625295:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625301:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625307:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625312:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625316:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625322:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625327:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625332:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625339:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625344:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625349:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625355:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625360:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625366:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625371:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.625377:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.625985:0:17119:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8951fb29b800:17119] 1 exiting: rc = 0 00000100:00100000:3.0:1787784877.626126:0:17118:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8951fb29b000:17118] 0 exiting: rc = 1 00000100:00100000:1.0:1787784877.626266:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626274:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626280:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626286:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626292:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626297:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626302:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626308:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626313:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626319:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626324:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626329:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626334:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626340:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626345:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626351:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626369:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626374:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626379:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626385:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626390:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626396:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626518:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626525:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626541:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626546:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626553:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626558:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626562:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626567:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626571:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626576:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626581:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626586:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626591:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626598:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626603:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626608:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626623:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626628:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626633:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626637:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626643:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626648:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626653:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626658:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626662:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626667:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626673:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626677:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626682:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626694:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626699:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626704:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626709:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626714:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626719:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626723:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626728:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626733:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626738:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626742:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626747:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.626753:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784877.627637:0:17120:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8951fa99c600:17120] 0 exiting: rc = 1 00000100:00100000:1.0:1787784877.628054:0:17122:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8951c2b9fc00:17122] 2 exiting: rc = 0 00000100:00100000:3.0:1787784877.628366:0:17121:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8951fb29a400:17121] 1 exiting: rc = 0 00000100:00100000:1.0:1787784877.628699:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.628709:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.628717:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.628723:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.628728:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.628733:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.628738:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.628743:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.628748:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.628753:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.628758:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.628763:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629038:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629046:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629052:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629075:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629082:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629087:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629091:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629097:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629102:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629123:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629129:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629135:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629141:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629146:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629151:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629156:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629162:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629167:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629174:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629180:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629261:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629266:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629272:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629279:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629285:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629290:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629295:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629317:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629325:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629331:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629336:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629342:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629348:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629353:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629359:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629367:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629372:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629379:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629384:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629389:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629395:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629471:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629480:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629485:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629500:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629505:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629510:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629516:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629522:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629537:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629544:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784877.629550:0:20881:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787784877.635353:0:20881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784877.635368:0:20881:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787784877.635374:0:20881:0:(genops.c:885:class_export_put()) final put ffff8950c41fa800/MDS_uuid 00000020:00000080:0.0:1787784877.635378:0:20881:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c41fa800/MDS_uuid for MDS 00000020:01000000:0.0:1787784877.635390:0:20881:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787784877.636004:0:20881:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1787784878.216874:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787784878.728818:0:18609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787784878.728828:0:18609:0:(genops.c:885:class_export_put()) final put ffff8950c2644800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1787784878.728857:0:18609:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787784878.728860:0:18609:0:(genops.c:885:class_export_put()) final put ffff8951c41dc800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787784878.728924:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c2644800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787784878.728985:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8951c41dc800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787784878.729001:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c2641000 for lustre-OST0000 00000020:00000080:2.0:1787784878.729006:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951c41da800 for lustre-OST0000 00010000:00010000:1.0:1787784879.246051:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784880.261949:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784881.286088:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787784881.567402:0:21082:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787784881.582964:0:21082:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787784881.583014:0:21082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9e0fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e105 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784881.583026:0:21082:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9e0fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e105 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784881.583031:0:21082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9e0fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9e105 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784881.583035:0:21082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9e0fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9e105 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784881.583060:0:21082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787784881.583064:0:21082:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787784881.583083:0:21082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787784881.583087:0:21082:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787784881.583091:0:21082:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787784881.583109:0:21082:0:(import.c:65:import_set_state_nolock()) ffff8951cfe41000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1787784881.583112:0:21082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787784881.583113:0:21082:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787784881.583115:0:21082:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787784881.583865:0:21082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787784881.583870:0:21082:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787784881.583874:0:21082:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787784881.583894:0:21082:0:(import.c:65:import_set_state_nolock()) ffff8950c2641800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1787784881.584026:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784881.584039:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9e0fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9e105 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784881.584047:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713000 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784881.584050:0:17095:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9e0fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9e105 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784881.584056:0:17095:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9e0fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9e105 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784881.584071:0:17095:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9e0fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9e105 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784881.584075:0:17095:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787784881.584077:0:17095:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787784881.584078:0:17095:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787784881.584090:0:17095:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8950c41f8800 00010000:00010000:3.0:1787784881.584093:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9e0fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9e105 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784881.584098:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8950c3713000/0x88ace7295d9e0fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9e105 expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784881.584106:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784881.584107:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784881.584108:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784881.584703:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1874627750238080:0@lo:39:umount.0 00000400:00000100:2.0:1787784881.584764:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874627750238080 offset 0 length 224: 4 00000100:00080000:2.0:1787784882.310924:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) a45ddeb3-718a-48eb-8507-e0c94319fca6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787784882.310933:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) a45ddeb3-718a-48eb-8507-e0c94319fca6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784882.310937:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787784882.310940:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787784882.310944:0:37:0:(import.c:65:import_set_state_nolock()) ffff8950c360c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787784882.310953:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 617 00000100:00080000:2.0:1787784882.310959:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787784882.310966:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8950c360c000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784882.311018:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fbe592c0 x1874627750238208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1787784882.311124:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784882.311139:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750238336:0@lo:400:kworker.0 00000400:00000100:0.0:1787784882.311192:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874627750238336 offset 0 length 224: 4 00000100:00100000:3.0:1787784882.311350:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874627750238208:0@lo:38:kworker.0 00000400:00000100:3.0:1787784882.311373:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874627750238208 offset 0 length 520: 4 00000001:00100000:2.0:1787784882.835241:0:19429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787784882.835253:0:19429:0:(genops.c:885:class_export_put()) final put ffff8950c2640800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787784882.838863:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c2640800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787784882.838946:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c2643000 for lustre-OST0001 00010000:00010000:2.0:1787784883.335714:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784884.358584:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784885.382039:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784886.406026:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787784887.430074:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) a45ddeb3-718a-48eb-8507-e0c94319fca6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787784887.430086:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) a45ddeb3-718a-48eb-8507-e0c94319fca6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787784887.430089:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787784887.430092:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787784887.430200:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784887.430225:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb257840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750238464:0@lo:400:kworker.0 00000400:00000100:2.0:1787784887.430299:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874627750238464 offset 0 length 224: 4 00010000:00010000:3.0:1787784887.430552:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784887.430605:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784877/real 1787784877] req@ffff8951fb2552c0 x1874627750237952/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787784887 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784887.430638:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8951fb2552c0 x1874627750237952/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787784887 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787784887.430654:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c41f8800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784887.430672:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787784887.430691:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb2552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a45ddeb3-718a-48eb-8507-e0c94319fca6:3643:1874627750237952:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1787784887.430752:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) a45ddeb3-718a-48eb-8507-e0c94319fca6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787784887.430756:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787784887.430759:0:37:0:(import.c:65:import_set_state_nolock()) ffff8950c41f8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787784887.430763:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.141@tcp: connect to NID 0@lo last attempt 617 00000100:00080000:3.0:1787784887.430787:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.141@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787784887.430795:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.141@tcp: import ffff8950c41f8800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1787784887.430819:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fd7c30c0 x1874627750238592/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787784887.430846:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787784887.430850:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787784887.431025:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a45ddeb3-718a-48eb-8507-e0c94319fca6:3643:1874627750238592:0@lo:250:kworker.0 00000400:00000100:2.0:1787784887.431054:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874627750238592 offset 0 length 520: 4 00010000:00010000:2.0:1787784888.454061:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784889.478179:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784890.501990:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784891.525907:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784881/real 1787784881] req@ffff8951d1b5c780 x1874627750238080/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787784891 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787784891.525929:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784891.525943:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8951d1b5c780 x1874627750238080/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787784891 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787784891.525964:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c2641800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787784891.525988:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1874627750238080:0@lo:39:umount.0 00000100:00080000:1.0:1787784891.526079:0:21082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787784891.526084:0:21082:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787784891.526089:0:21082:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787784891.528688:0:21082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e0d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e0db expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784891.528706:0:21082:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e0d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e0db expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784891.528714:0:21082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e0d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9e0db expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784891.528722:0:21082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e0d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9e0db expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784891.528825:0:21082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787784891.528833:0:21082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9e42a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e431 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784891.528840:0:21082:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9e42a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e431 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784891.528863:0:21082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9e42a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9e431 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784891.528870:0:21082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9e42a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9e431 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784891.539657:0:19445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784891.539671:0:19445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e0d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9e0db expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784891.539683:0:19445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628800 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784891.539688:0:19445:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e0d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9e0db expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784891.539697:0:19445:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e0d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9e0db expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784891.539704:0:19445:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e0d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9e0db expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784891.539709:0:19445:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787784891.539713:0:19445:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1787784891.539729:0:19445:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8950c41f8800 00010000:00010000:2.0:1787784891.539732:0:19445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e0d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9e0db expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784891.539739:0:19445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e0d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9e0db expref: -99 pid: 18608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784891.539792:0:19445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784891.539796:0:19445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9e42a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9e431 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784891.539802:0:19445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d35a00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784891.539805:0:19445:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9e42a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9e431 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784891.539812:0:19445:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9e42a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9e431 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784891.539818:0:19445:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9e42a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9e431 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784891.539823:0:19445:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787784891.539825:0:19445:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1787784891.539830:0:19445:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8950c41f8800 00010000:00010000:2.0:1787784891.539832:0:19445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9e42a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9e431 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784891.539838:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784891.539840:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784891.539842:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784891.539932:0:21082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787784891.539939:0:21082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951e1d35a00/0x88ace7295d9e42a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9e431 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784891.539951:0:21082:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1787784891.539957:0:21082:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1787784891.539959:0:21082:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787784891.539996:0:21082:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787784891.540000:0:21082:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787784891.540006:0:21082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787784891.540012:0:21082:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787784891.540016:0:21082:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff895201d0cd28) has no exports 00000020:00080000:1.0:1787784891.540040:0:21082:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff895201d0cd28) has no exports 00010000:00010000:3.0:1787784891.541037:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787784891.541872:0:21082:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8950c19d7840 - data ffff8951f08201b0/ffff8951fd523c00 00000020:01000000:1.0:1787784891.542035:0:21082:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8950c22ecc00 - data ffff8951f0b07438/ffff8951d19eec00 00100000:10000000:1.0:1787784891.551434:0:21082:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787784891.563791:0:21082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e0e9 00000020:00000080:0.0:1787784891.563810:0:21082:0:(genops.c:885:class_export_put()) final put ffff8950c344d000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787784891.563829:0:21082:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951f6b92000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787784891.563833:0:21082:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951f6b92000 2 00000020:01000004:0.0:1787784891.563836:0:21082:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8951f6b92000 from lustre-OST0000 00000020:00000080:3.0:1787784891.563867:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c344d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787784891.563881:0:21082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784891.563910:0:21082:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787784891.563914:0:21082:0:(genops.c:885:class_export_put()) final put ffff8951f67d9800/lustre-OST0000_UUID 00000020:00000080:0.0:1787784891.563917:0:21082:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f67d9800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787784891.563929:0:21082:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787784891.564012:0:21082:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787784891.564017:0:21082:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787784891.564021:0:21082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787784891.564027:0:21082:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787784891.564034:0:21082:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8951c2cc7000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787784891.564040:0:21082:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff8951ebd50000) has exports, disconnecting them 00000020:00080000:0.0:1787784891.564045:0:21082:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8951c2cc7000), last request at 1787784804 00000020:00000080:0.0:1787784891.564049:0:21082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e113 00000020:00080000:0.0:1787784891.564059:0:21082:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8951c2cc7000): rc 0 00000020:00000080:0.0:1787784891.564065:0:21082:0:(genops.c:885:class_export_put()) final put ffff8951c2cc7000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787784891.564354:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8951c2cc7000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787784891.569841:0:21082:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787784891.569850:0:21082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787784891.569853:0:21082:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787784891.569860:0:21082:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787784891.569900:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8951cfe41000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787784891.570055:0:21082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784891.570064:0:21082:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787784891.570085:0:21082:0:(genops.c:885:class_export_put()) final put ffff8951c2cc0000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787784891.570089:0:21082:0:(genops.c:844:class_export_destroy()) destroying export ffff8951c2cc0000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787784891.570104:0:21082:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1787784891.570200:0:21082:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787784891.570204:0:21082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787784891.570210:0:21082:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787784891.570216:0:21082:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8950c2647000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787784891.570223:0:21082:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff8951ebd54d28) has exports, disconnecting them 00000020:00080000:2.0:1787784891.570228:0:21082:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8950c2647000), last request at 1787784804 00000020:00000080:2.0:1787784891.570232:0:21082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e128 00000020:00080000:2.0:1787784891.570245:0:21082:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8950c2647000): rc 0 00000020:00000080:2.0:1787784891.570249:0:21082:0:(genops.c:885:class_export_put()) final put ffff8950c2647000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787784891.570309:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c2647000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1787784891.588990:0:21082:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787784891.588998:0:21082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787784891.589003:0:21082:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787784891.589011:0:21082:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787784891.589036:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c2641800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787784891.589223:0:21082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784891.589232:0:21082:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1787784891.589237:0:21082:0:(genops.c:885:class_export_put()) final put ffff8951cfe42000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1787784891.589241:0:21082:0:(genops.c:844:class_export_destroy()) destroying export ffff8951cfe42000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1787784891.589248:0:21082:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1787784891.589325:0:21082:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951f6b92000 1 00000020:00000080:3.0:1787784891.589332:0:21082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e0c6 00000020:00000080:3.0:1787784891.589339:0:21082:0:(genops.c:885:class_export_put()) final put ffff8951c4564000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787784891.589347:0:21082:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787784891.589355:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8951c4564000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787784891.589364:0:21082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784891.589368:0:21082:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787784891.589372:0:21082:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff8951fd7b99b8) has no exports 00000020:00000080:3.0:1787784891.714746:0:21082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784891.714902:0:21082:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787784891.714909:0:21082:0:(genops.c:885:class_export_put()) final put ffff8951f6b94800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787784891.714913:0:21082:0:(genops.c:844:class_export_destroy()) destroying export ffff8951f6b94800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787784891.714926:0:21082:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787784891.715189:0:21082:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8951f6b91800 00000020:02000400:3.0:1787784891.715235:0:21082:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:3.0:1787784892.549839:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) a45ddeb3-718a-48eb-8507-e0c94319fca6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787784892.549849:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) a45ddeb3-718a-48eb-8507-e0c94319fca6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787784892.549852:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787784892.549855:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787784892.549902:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784892.549950:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750238720:0@lo:400:kworker.0 00000400:00000100:1.0:1787784892.550003:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874627750238720 offset 0 length 224: 4 00010000:00010000:0.0:1787784893.587154:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784894.622011:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784895.621888:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787784895.775116:0:21285:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787784895.792898:0:21285:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787784895.792993:0:21285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182200/0x88ace7295d9e25c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e263 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784895.793009:0:21285:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182200/0x88ace7295d9e25c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e263 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784895.793031:0:21285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182200/0x88ace7295d9e25c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9e263 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784895.793040:0:21285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8950c4182200/0x88ace7295d9e25c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9e263 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784895.793066:0:21285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787784895.793085:0:21285:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787784895.793126:0:21285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787784895.793139:0:21285:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8951fbe592c0 x1874627750238208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787784897 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784895.793162:0:21285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787784895.793168:0:21285:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787784895.793175:0:21285:0:(import.c:65:import_set_state_nolock()) ffff8950c360c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787784895.793179:0:21285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787784895.793183:0:21285:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8951fbe592c0 x1874627750238208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787784897 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784895.793190:0:21285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787784895.793193:0:21285:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:3.0:1787784895.793544:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874627750238208:0@lo:38:kworker.0 00010000:00010000:0.0:1787784895.793955:0:19445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784895.793965:0:19445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8950c4182200/0x88ace7295d9e25c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9e263 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784895.793975:0:19445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182200 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784895.793980:0:19445:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8950c4182200/0x88ace7295d9e25c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9e263 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784895.793990:0:19445:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8950c4182200/0x88ace7295d9e25c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9e263 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784895.793998:0:19445:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8950c4182200/0x88ace7295d9e25c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9e263 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784895.794005:0:19445:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787784895.794016:0:19445:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787784895.794019:0:19445:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787784895.794042:0:19445:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8950c41f8800 00010000:00010000:0.0:1787784895.794047:0:19445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8950c4182200/0x88ace7295d9e25c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9e263 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784895.794054:0:19445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8950c4182200/0x88ace7295d9e25c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9e263 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784895.794066:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784895.794068:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784895.794070:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787784895.796487:0:21285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787784895.796505:0:21285:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8951fbe59e00 x1874627750238336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784898 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784895.796948:0:21285:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8951fb257840 x1874627750238464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784903 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784895.797008:0:21285:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8951fd7c2580 x1874627750238720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784908 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784895.797027:0:21285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787784895.797034:0:21285:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787784895.797060:0:21285:0:(import.c:65:import_set_state_nolock()) ffff8950c360b800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787784895.797093:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1874627750238848:0@lo:39:umount.0 00000400:00000100:2.0:1787784895.797159:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874627750238848 offset 0 length 224: 4 00000100:00100000:3.0:1787784895.798352:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb257840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750238464:0@lo:400:kworker.0 00000100:00100000:2.0:1787784895.798495:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750238720:0@lo:400:kworker.0 00000100:00100000:0.0:1787784895.801890:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750238336:0@lo:400:kworker.0 00010000:00010000:1.0:1787784896.646465:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787784897.670889:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) a45ddeb3-718a-48eb-8507-e0c94319fca6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787784897.670898:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) a45ddeb3-718a-48eb-8507-e0c94319fca6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1787784897.671431:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784898.695045:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784899.718009:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784900.742286:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784901.766350:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784902.789913:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787784902.789983:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a45ddeb3-718a-48eb-8507-e0c94319fca6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787784902.789989:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) a45ddeb3-718a-48eb-8507-e0c94319fca6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787784902.982472:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784887/real 1787784887] req@ffff8951fd7c30c0 x1874627750238592/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787784902 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784902.982506:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8951fd7c30c0 x1874627750238592/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787784902 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787784902.982546:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c41f8800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787784902.982642:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1787784902.982647:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a45ddeb3-718a-48eb-8507-e0c94319fca6:3643:1874627750238592:0@lo:250:kworker.0 00000100:00080000:0.0:1787784902.990580:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a45ddeb3-718a-48eb-8507-e0c94319fca6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787784902.990592:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787784902.990596:0:38:0:(import.c:65:import_set_state_nolock()) ffff8950c41f8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784902.990606:0:38:0:(import.c:510:import_select_connection()) MGC192.168.202.141@tcp: connect to NID 0@lo last attempt 627 00000100:00080000:0.0:1787784902.990613:0:38:0:(import.c:589:import_select_connection()) MGC192.168.202.141@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787784902.990620:0:38:0:(import.c:624:import_select_connection()) MGC192.168.202.141@tcp: import ffff8950c41f8800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784902.990656:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fb2552c0 x1874627750238976/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787784902.990764:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb2552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a45ddeb3-718a-48eb-8507-e0c94319fca6:3643:1874627750238976:0@lo:250:kworker.0 00000400:00000100:3.0:1787784902.990850:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874627750238976 offset 0 length 520: 4 00010000:00010000:3.0:1787784903.814681:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784904.838171:0:19445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784905.030656:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784895/real 1787784895] req@ffff8951fbe59a40 x1874627750238848/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787784905 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784905.030693:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8951fbe59a40 x1874627750238848/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787784905 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787784905.030713:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c360b800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787784905.030739:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1874627750238848:0@lo:39:umount.0 00000100:00080000:2.0:1787784905.032641:0:21285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787784905.032670:0:21285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787784905.032679:0:21285:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787784905.034692:0:21285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e232 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e239 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784905.034711:0:21285:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e232 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e239 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784905.034719:0:21285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e232 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9e239 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784905.034725:0:21285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e232 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9e239 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784905.034755:0:21285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784905.034762:0:21285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9e41c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e423 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784905.034798:0:21285:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9e41c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e423 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784905.034805:0:21285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9e41c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9e423 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784905.034811:0:21285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9e41c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x88ace7295d9e423 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784905.034891:0:21285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787784905.034897:0:21285:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787784905.034933:0:21285:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787784905.034938:0:21285:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787784905.035533:0:21285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787784905.035542:0:21285:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787784905.035547:0:21285:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8951ebd519b8) has no exports 00000020:00080000:2.0:1787784905.035574:0:21285:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8951ebd519b8) has no exports 00010000:00010000:3.0:1787784905.045923:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787784905.046068:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e232 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9e239 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784905.046082:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182a00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784905.046086:0:17096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e232 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9e239 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784905.046097:0:17096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9e239 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784905.046105:0:17096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9e239 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784905.046133:0:17096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787784905.046136:0:17096:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1787784905.046139:0:17096:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1787784905.046160:0:17096:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8950c41f8800 00010000:00010000:3.0:1787784905.046163:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e232 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9e239 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784905.046170:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8950c4182a00/0x88ace7295d9e232 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9e239 expref: -99 pid: 19428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784905.046185:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784905.046189:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9e41c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9e423 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784905.046195:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d35c00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:3.0:1787784905.046197:0:17096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9e41c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x88ace7295d9e423 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784905.046204:0:17096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9e41c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9e423 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784905.046209:0:17096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9e41c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9e423 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784905.046214:0:17096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787784905.046216:0:17096:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787784905.046218:0:17096:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787784905.046223:0:17096:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8950c41f8800 00010000:00010000:3.0:1787784905.048608:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9e41c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9e423 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784905.048640:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951e1d35c00/0x88ace7295d9e41c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9e423 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784905.048666:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784905.048668:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784905.048672:0:17096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787784905.050065:0:21285:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8950c3086540 - data ffff8951f0af16c0/ffff8950c22ab000 00000020:01000000:2.0:1787784905.050216:0:21285:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8950c3086000 - data ffff8951e0f8ae58/ffff8951c41abc00 00010000:00010000:1.0:1787784905.055254:0:17095:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1787784905.067117:0:21285:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787784905.081651:0:21285:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e247 00000020:00000080:3.0:1787784905.081662:0:21285:0:(genops.c:885:class_export_put()) final put ffff8951efedf800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787784905.081684:0:21285:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951c7764000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787784905.081689:0:21285:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951c7764000 2 00000020:01000004:3.0:1787784905.081693:0:21285:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8951c7764000 from lustre-OST0001 00000020:00000080:3.0:1787784905.081716:0:21285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784905.081726:0:21285:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787784905.081729:0:21285:0:(genops.c:885:class_export_put()) final put ffff8950c2647800/lustre-OST0001_UUID 00000020:00000080:3.0:1787784905.081732:0:21285:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c2647800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787784905.081738:0:21285:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1787784905.082102:0:21285:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import a45ddeb3-718a-48eb-8507-e0c94319fca6->MGS 00010000:00010000:3.0:1787784905.082118:0:21285:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9df92 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9df99 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784905.082130:0:21285:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9df92 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9df99 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784905.082137:0:21285:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787784905.082140:0:21285:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787784905.082144:0:21285:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787784905.082157:0:21285:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8950c41f8800 00010000:00010000:3.0:1787784905.082162:0:21285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9df92 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9df99 expref: -99 pid: 17839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784905.082191:0:21285:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9de81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x88ace7295d9de88 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784905.082198:0:21285:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9de81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x88ace7295d9de88 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784905.082204:0:21285:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787784905.082206:0:21285:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787784905.082208:0:21285:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787784905.082217:0:21285:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8950c41f8800 00010000:00010000:3.0:1787784905.082220:0:21285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8950c3713400/0x88ace7295d9de81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x88ace7295d9de88 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787784905.082240:0:21285:0:(import.c:65:import_set_state_nolock()) ffff8950c41f8800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787784905.082243:0:21285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787784905.082245:0:21285:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787784905.082247:0:21285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787784905.082251:0:21285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787784905.082261:0:21285:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8951fb2552c0 x1874627750238976/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787784922 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787784905.082334:0:21285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787784905.082337:0:21285:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000020:00000080:0.0:1787784905.082392:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951efedf800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1787784905.082441:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb2552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a45ddeb3-718a-48eb-8507-e0c94319fca6:3643:1874627750238976:0@lo:250:kworker.0 10000000:01000000:3.0:1787784905.082504:0:21285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787784905.082511:0:21285:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9de6c 00000020:00000080:3.0:1787784905.082516:0:21285:0:(genops.c:885:class_export_put()) final put ffff8950c41f9800/a45ddeb3-718a-48eb-8507-e0c94319fca6 00000020:01000000:3.0:1787784905.082528:0:21285:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.141@tcp (flags='') 00000020:00000080:3.0:1787784905.082532:0:21285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784905.082537:0:21285:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.141@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787784905.082540:0:21285:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8951cfef4d28) has no exports 10000000:01000000:1.0:1787784905.082586:0:17104:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:0.0:1787784905.082646:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c41f9800/a45ddeb3-718a-48eb-8507-e0c94319fca6 for MGC192.168.202.141@tcp 10000000:01000000:3.0:1787784905.082679:0:21285:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.141@tcp: client import never connected 00000100:00080000:3.0:1787784905.082686:0:21285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787784905.082688:0:21285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787784905.082690:0:21285:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787784905.082692:0:21285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787784905.082738:0:21285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784905.082742:0:21285:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.141@tcp (uuid a45ddeb3-718a-48eb-8507-e0c94319fca6) 00000020:01000000:3.0:1787784905.082747:0:21285:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787784905.082750:0:21285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784905.082753:0:21285:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787784905.082757:0:21285:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8950c360d000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787784905.082762:0:21285:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff8951f02d99b8) has exports, disconnecting them 00000020:00000080:0.0:1787784905.082831:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c41f8800 for MGC192.168.202.141@tcp 00000020:00000080:0.0:1787784905.082838:0:38:0:(genops.c:885:class_export_put()) final put ffff8950c41fb000/a45ddeb3-718a-48eb-8507-e0c94319fca6 00000020:00000080:0.0:1787784905.082840:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c41fb000/a45ddeb3-718a-48eb-8507-e0c94319fca6 for MGC192.168.202.141@tcp 00000020:01000000:0.0:1787784905.082844:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.141@tcp (a45ddeb3-718a-48eb-8507-e0c94319fca6) 00000020:00080000:3.0:1787784905.083300:0:21285:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8950c360d000), last request at 1787784825 00000020:00000080:3.0:1787784905.083307:0:21285:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e271 00000020:00080000:3.0:1787784905.083319:0:21285:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8950c360d000): rc 0 00000020:00000080:3.0:1787784905.083323:0:21285:0:(genops.c:885:class_export_put()) final put ffff8950c360d000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787784905.085928:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c360d000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787784905.087070:0:21285:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787784905.087076:0:21285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787784905.087080:0:21285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787784905.087087:0:21285:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787784905.087267:0:21285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784905.087276:0:21285:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1787784905.087292:0:21285:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787784905.087298:0:21285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787784905.087302:0:21285:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787784905.087310:0:21285:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8951c41da000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787784905.087315:0:21285:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8951f02d8000) has exports, disconnecting them 00000020:00080000:0.0:1787784905.087321:0:21285:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8951c41da000), last request at 1787784825 00000020:00000080:0.0:1787784905.087325:0:21285:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e286 00000020:00080000:0.0:1787784905.087341:0:21285:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8951c41da000): rc 0 00000020:00000080:0.0:1787784905.087346:0:21285:0:(genops.c:885:class_export_put()) final put ffff8951c41da000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1787784905.088041:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c360c000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787784905.088052:0:38:0:(genops.c:885:class_export_put()) final put ffff8950c360a000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787784905.088054:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c360a000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787784905.088066:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787784905.088135:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8951c41da000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1787784905.089379:0:21285:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787784905.089387:0:21285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787784905.089390:0:21285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787784905.089397:0:21285:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787784905.089422:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8950c360b800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1787784905.089476:0:19445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1787784905.216600:0:17096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787784905.216875:0:17095:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1787784905.217178:0:17091:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8951df6ec400:17091] 1 exiting: rc = 0 00000100:00100000:0.0:1787784905.217420:0:17090:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8951df6eca00:17090] 0 exiting: rc = 1 00000100:00100000:1.0:1787784905.217573:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.217863:0:17094:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8951fb289400:17094] 2 exiting: rc = 0 00000100:00100000:0.0:1787784905.217918:0:17093:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8951df6ece00:17093] 1 exiting: rc = 0 00000100:00100000:1.0:1787784905.217921:0:17092:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8951df6ecc00:17092] 0 exiting: rc = 1 00000100:00100000:3.0:1787784905.218062:0:20136:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8950c41e1e00:20136] 3 exiting: rc = 0 00000100:00100000:0.0:1787784905.218325:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218332:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218339:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218345:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218350:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218357:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218373:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218378:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218383:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218388:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218393:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218399:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218404:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218410:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218414:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218419:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218425:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218430:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218435:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218440:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218446:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218451:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218456:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218461:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218467:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218472:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218478:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218483:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218489:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218494:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218499:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218505:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218510:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218515:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218521:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218526:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218531:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218536:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218542:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218547:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218553:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218565:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218570:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218576:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218581:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218586:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218591:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218596:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218601:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218606:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218611:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218616:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218621:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218627:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218633:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218638:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218643:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218649:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218654:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218659:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218665:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218670:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218687:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.218693:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787784905.228345:0:21285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784905.228361:0:21285:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1787784905.228367:0:21285:0:(genops.c:885:class_export_put()) final put ffff8950c360f800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1787784905.228372:0:21285:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c360f800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1787784905.228379:0:21285:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1787784905.228447:0:21285:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951c7764000 1 00000020:00000080:0.0:1787784905.228453:0:21285:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88ace7295d9e22b 00000020:00000080:0.0:1787784905.228460:0:21285:0:(genops.c:885:class_export_put()) final put ffff8950c2642000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787784905.228479:0:21285:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787784905.228483:0:21285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787784905.228487:0:21285:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787784905.228500:0:21285:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff8951fd7bb370) has no exports 00000020:00000080:1.0:1787784905.228732:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8950c2642000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787784905.286719:0:21285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787784905.286734:0:21285:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787784905.286739:0:21285:0:(genops.c:885:class_export_put()) final put ffff8951c7764800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787784905.286744:0:21285:0:(genops.c:844:class_export_destroy()) destroying export ffff8951c7764800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787784905.286755:0:21285:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787784905.287354:0:21285:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8951c7763000 00000020:01000000:1.0:1787784905.287377:0:21285:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787784905.287380:0:21285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787784905.287392:0:21285:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787784905.287396:0:21285:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8951f02db370) has no exports 00000020:00000080:1.0:1787784905.287433:0:21285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787784905.287439:0:21285:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787784905.287441:0:21285:0:(genops.c:885:class_export_put()) final put ffff8951c4565000/OSS_uuid 00000020:00000080:1.0:1787784905.287444:0:21285:0:(genops.c:844:class_export_destroy()) destroying export ffff8951c4565000/OSS_uuid for OSS 00000020:01000000:1.0:1787784905.287448:0:21285:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1787784905.287521:0:18614:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8950c19dd200:18614] 2 exiting: rc = 0 00000100:00100000:1.0:1787784905.287740:0:18613:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8950c19dcc00:18613] 1 exiting: rc = 0 00000100:00080000:0.0:1787784905.288919:0:17103:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787784905.289211:0:19016:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8950c43e8200:19016] 3 exiting: rc = 0 00000100:00100000:3.0:1787784905.289302:0:18612:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8950c19dc600:18612] 0 exiting: rc = 1 00000100:00100000:1.0:1787784905.291322:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291334:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291340:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291345:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291351:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291356:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291360:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291365:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291372:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291377:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291382:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291386:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291390:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291394:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291398:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291403:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291407:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291412:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291417:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291421:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291425:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291429:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291434:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291438:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291442:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291446:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291466:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291471:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291475:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291480:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291485:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291490:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291494:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291499:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291503:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291508:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291512:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291518:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291522:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291539:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291545:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291550:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291556:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291560:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291565:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291569:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291574:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291580:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291584:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291589:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291593:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291597:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291601:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291606:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291611:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291615:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291619:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291623:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291628:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291632:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291636:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291653:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291658:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.291667:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.294699:0:18615:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8951fa954400:18615] 0 exiting: rc = 1 00000100:00100000:0.0:1787784905.294962:0:18617:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8951d1bfae00:18617] 1 exiting: rc = 0 00000100:00100000:1.0:1787784905.295713:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295720:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295724:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295729:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295734:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295739:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295744:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295749:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295755:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295760:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295765:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295784:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295789:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295795:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295801:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295806:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295811:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295817:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295822:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295827:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295831:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295836:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295840:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295844:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295849:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295854:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295859:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295865:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295870:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295900:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295907:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295914:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.295929:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296357:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296366:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296371:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296375:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296380:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296385:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296391:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296396:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296401:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296406:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296412:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296417:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296422:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296427:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296432:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296437:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296442:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296446:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296450:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296454:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296459:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296463:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296467:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296472:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296476:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296480:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296485:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296489:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296493:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296497:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.296501:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784905.299560:0:20250:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff8950c41e2000:20250] 3 exiting: rc = 0 00000100:00100000:1.0:1787784905.299741:0:18619:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8951d1bfa400:18619] 1 exiting: rc = 0 00000100:00100000:0.0:1787784905.300078:0:18620:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8951fa955000:18620] 2 exiting: rc = 0 00000100:00100000:2.0:1787784905.305427:0:18618:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8951fa955400:18618] 0 exiting: rc = 1 00000100:00100000:3.0:1787784905.309612:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.309625:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.309641:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.309649:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.309655:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.309661:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312660:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312683:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312689:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312695:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312717:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312725:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312730:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312736:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312741:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312745:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312750:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312756:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312762:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312812:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312820:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312826:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312831:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312837:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312843:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312848:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312853:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312858:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312864:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312870:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312875:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312880:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312886:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312891:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312897:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312903:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312908:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312914:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312920:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312926:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312931:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312937:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312943:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312964:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312970:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312981:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312987:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.312993:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.313000:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.313005:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.313010:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.313016:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.313021:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.313026:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.313032:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.313038:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.313044:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.313049:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.313055:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.313060:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.313077:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.313105:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.313111:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.313124:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784905.348023:0:18621:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8951df6edc00:18621] 0 exiting: rc = 1 00000100:00100000:1.0:1787784905.350927:0:18622:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8951df6ec200:18622] 1 exiting: rc = 0 00000100:00100000:2.0:1787784905.351418:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351425:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351430:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351434:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351439:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351444:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351449:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351454:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351458:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351463:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351468:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351473:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351478:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351483:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351487:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351492:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351497:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351502:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351507:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351512:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351517:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351522:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351526:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351531:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351535:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351548:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351553:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351557:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351562:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351567:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351572:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351577:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351583:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351591:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351596:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351605:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351611:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351617:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351621:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351625:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351630:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351634:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351638:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351643:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351647:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351651:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351656:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351661:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351684:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351690:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351695:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351699:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351704:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351709:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351713:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351718:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351722:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351726:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351730:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351735:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351747:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351753:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351757:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.351761:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784905.352671:0:18623:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8950c19dee00:18623] 0 exiting: rc = 1 00000100:00100000:2.0:1787784905.391686:0:18624:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8951e1e0ee00:18624] 1 exiting: rc = 0 00000100:00100000:3.0:1787784905.391941:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.391951:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.391958:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.391964:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.391969:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.391975:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.391980:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.391986:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.391994:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392000:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392006:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392012:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392034:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392042:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392050:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392056:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392074:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392080:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392086:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392103:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392110:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392116:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392122:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392128:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392148:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392154:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392161:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392168:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392174:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392181:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392188:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392193:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392208:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392214:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392221:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392228:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392250:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392258:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392265:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392271:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392286:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392294:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392300:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392306:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392312:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392318:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392323:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392330:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392350:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392357:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392365:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392377:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392383:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392389:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392396:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392403:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392409:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392416:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392421:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392428:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392441:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392456:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392463:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784905.392475:0:21285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787784905.425063:0:21285:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1787784925.763978:0:22050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787784935.956516:0:22649:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787784935.956524:0:22649:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1787784935.956526:0:22649:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787784935.956639:0:22649:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8951ff20c000 00000020:01000004:0.0:1787784935.956654:0:22649:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1787784935.956724:0:22649:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787784935.956741:0:22649:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8951fd7bcd28) 00000020:00000080:0.0:1787784935.956756:0:22649:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787784936.037753:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787784936.038790:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787784936.041744:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1787784936.042728:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1787784936.042949:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1787784936.043647:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787784936.044189:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787784936.044423:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787784936.044668:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787784936.044888:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787784936.045121:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1787784936.045304:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787784936.045483:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1787784936.046102:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1787784936.046416:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1787784936.047322:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787784936.047545:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787784936.047790:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787784936.048238:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787784936.048576:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787784936.048950:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787784936.049257:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787784936.049579:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787784936.049826:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787784936.050037:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787784936.050252:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787784936.050709:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787784936.051052:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787784936.051241:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787784936.051453:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787784936.051801:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1787784936.051996:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787784936.054896:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1787784936.055231:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787784936.055440:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1787784936.055638:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787784936.055919:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787784936.057889:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787784936.058378:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1787784936.061146:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1787784936.061728:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1787784936.062244:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1787784936.062509:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1787784936.062794:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1787784936.063076:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1787784936.063318:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1787784936.063870:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1787784936.066085:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1787784936.066441:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1787784936.066621:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1787784936.071753:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1787784936.072137:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1787784936.072338:0:22649:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:1.0:1787784936.073120:0:22649:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787784936.073325:0:22649:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787784936.073333:0:22649:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787784936.073345:0:22649:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9e6df 00000020:01000004:1.0:1787784936.073351:0:22649:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1787784936.073356:0:22649:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787784936.073361:0:22649:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8951ff20c000 from MGS 00000020:01000004:1.0:1787784936.073365:0:22649:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787784936.073374:0:22649:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8951ebd53370) 00000020:00000080:1.0:1787784936.073384:0:22649:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787784936.073443:0:22649:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951ff20c000 from MGS, refs=2 00080000:01000000:1.0:1787784936.073447:0:22649:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787784936.073452:0:22649:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9e6ed 00000100:00100000:1.0:1787784936.073541:0:22649:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787784936.075051:0:22649:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787784936.075062:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787784936.080036:0:22649:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787784936.080049:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787784936.080635:0:22649:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784936.080856:0:22649:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787784936.080861:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787784936.081380:0:22649:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787784936.081386:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787784936.081728:0:22649:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787784936.081734:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787784936.085748:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784936.085753:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784936.085755:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784936.086125:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784936.086127:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784936.086129:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784936.086805:0:22649:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787784936.097576:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787784936.100428:0:22649:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787784936.101302:0:22661:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787784936.101349:0:22649:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787784936.101386:0:22649:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787784936.101987:0:22649:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787784936.102347:0:22649:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784936.102490:0:22649:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787784936.102501:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787784936.104490:0:22649:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787784936.104501:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787784936.104914:0:22649:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787784936.104921:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787784936.106364:0:22649:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787784936.106388:0:22649:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.141@tcp' 00000020:01000004:1.0:1787784936.106389:0:22649:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787784936.106420:0:22649:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.141@tcp (typ=mgc) 00000020:00000080:1.0:1787784936.106433:0:22649:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.141@tcp (ffff8951ebd519b8) 00000020:00000080:1.0:1787784936.106448:0:22649:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787784936.106534:0:22649:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8951ff094000@MGC192.168.202.141@tcp: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1787784936.106756:0:22649:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.141@tcp-0 is initialized 00000040:01000000:1.0:1787784936.106762:0:22649:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787784936.106942:0:22665:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787784936.116818:0:22668:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787784936.117075:0:22649:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.141@tcp (uuid 8e11354d-250d-4393-8e0e-7593eb008ce7) 00000020:00000080:1.0:1787784936.117101:0:22649:0:(genops.c:1385:class_connect()) connect: client 8e11354d-250d-4393-8e0e-7593eb008ce7, cookie 0x88ace7295d9e6fb 00000100:00080000:1.0:1787784936.117114:0:22649:0:(import.c:510:import_select_connection()) MGC192.168.202.141@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787784936.117120:0:22649:0:(import.c:624:import_select_connection()) MGC192.168.202.141@tcp: import ffff8951ff094000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784936.117155:0:22649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951d1b5c3c0 x1874627750239104/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787784936.117182:0:22649:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8e11354d-250d-4393-8e0e-7593eb008ce7->MGS 00000020:01000004:1.0:1787784936.117207:0:22649:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787784936.117213:0:22649:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787784936.117228:0:22649:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8951ebd54d28) 00000020:00000080:1.0:1787784936.117240:0:22649:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787784936.118167:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e11354d-250d-4393-8e0e-7593eb008ce7:3643:1874627750239104:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787784936.118264:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784936.118346:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750239104 00000100:00100000:3.0:1787784936.118355:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750239104 00000100:00100000:3.0:1787784936.118397:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784936.118405:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1874627750239104:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1787784936.118434:0:22662:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 8e11354d-250d-4393-8e0e-7593eb008ce7@0@lo t0 exp 0000000000000000 cur 676 last 0 00000020:00000080:3.0:1787784936.118460:0:22662:0:(genops.c:1385:class_connect()) connect: client 8e11354d-250d-4393-8e0e-7593eb008ce7, cookie 0x88ace7295d9e709 00000100:00080000:3.0:1787784936.119026:0:22662:0:(import.c:65:import_set_state_nolock()) ffff8951c4548000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787784936.119088:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+5:3643:x1874627750239104:12345-0@lo:250:mount.lustre.0 Request processed in 682us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784936.119096:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784936.120054:0:3643:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.141@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787784936.120066:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.141@tcp: connect to target with instance 0 00000100:00080000:3.0:1787784936.120075:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.141@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787784936.120081:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787784936.120085:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951ff094000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787784936.120087:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787784936.120096:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787784936.120102:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e11354d-250d-4393-8e0e-7593eb008ce7:3643:1874627750239104:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787784936.146051:0:22649:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784936.146258:0:22649:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787784936.146266:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787784936.149686:0:22649:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787784936.149701:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787784936.150338:0:22649:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787784936.150345:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787784936.151190:0:22649:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784936.151390:0:22649:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787784936.151408:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787784936.152331:0:22649:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787784936.152340:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787784936.205363:0:22649:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784936.205575:0:22649:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787784936.205583:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787784936.207045:0:22649:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787784936.207056:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787784936.207560:0:22649:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784936.207939:0:22649:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787784936.207945:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787784936.208571:0:22649:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787784936.208577:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787784936.220935:0:22649:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784936.221128:0:22649:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787784936.221134:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787784936.222172:0:22649:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787784936.222182:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787784936.223064:0:22649:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784936.223222:0:22649:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787784936.223228:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787784936.224201:0:22649:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787784936.224209:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787784936.245828:0:22649:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784936.246045:0:22649:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787784936.246052:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787784936.247396:0:22649:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787784936.247406:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787784936.252314:0:22649:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787784936.252331:0:22649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787784936.253165:0:22649:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787784936.253192:0:22649:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787784936.253198:0:22649:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.141@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787784936.253301:0:22649:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787784936.253334:0:22649:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.141@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787784936.253339:0:22649:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787784936.253341:0:22649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787784936.253342:0:22649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787784936.253344:0:22649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787784936.253345:0:22649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787784936.253346:0:22649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787784936.253347:0:22649:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787784936.253349:0:22649:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787784936.253350:0:22649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787784936.253352:0:22649:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787784936.253354:0:22649:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787784936.253357:0:22649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787784936.253358:0:22649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787784936.253359:0:22649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787784936.253361:0:22649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787784936.253362:0:22649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787784936.253363:0:22649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787784936.253364:0:22649:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787784936.253365:0:22649:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787784936.253366:0:22649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787784936.253367:0:22649:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787784936.253393:0:22649:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787784936.253412:0:22649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750239232:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787784936.253485:0:22649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784936.253527:0:22649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa99ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784936.253631:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750239232 00000100:00100000:2.0:1787784936.253637:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750239232 00000100:00100000:2.0:1787784936.253680:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784936.253689:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+5:22649:x1874627750239232:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787784936.253736:0:22664:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787784936.253739:0:22664:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787784936.253742:0:22664:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787784936.254018:0:22685:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787784936.254536:0:22664:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1787784936.255720:0:22686:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787784936.255726:0:22686:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1787784936.255730:0:22686:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787784936.255732:0:22686:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787784936.256405:0:22686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1787784936.258048:0:22664:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787784936.258071:0:22664:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787784936.259624:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+5:22649:x1874627750239232:12345-0@lo:253:mount.lustre.0 Request processed in 5929us (6131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784936.259637:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784936.261873:0:22649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750239232:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787784936.261897:0:22649:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787784936.261900:0:22649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787784936.261902:0:22649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787784936.261903:0:22649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784936.261920:0:22649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784936.261921:0:22649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784936.261922:0:22649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784936.261923:0:22649:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787784936.261925:0:22649:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787784936.261926:0:22649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784936.261928:0:22649:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787784936.261951:0:22649:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8951ff20c000 from lustre-MDT0000 10000000:01000000:2.0:1787784936.261983:0:22649:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787784936.261986:0:22649:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787784936.261991:0:22649:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8951ebd519b8 10000000:01000000:2.0:1787784936.261994:0:22649:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787784936.262013:0:22649:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8951ebd519b8 from 1 10000000:01000000:2.0:1787784936.262016:0:22649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787784936.262058:0:22649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784936.262070:0:22649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784936.262081:0:22649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784936.262102:0:22649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe5b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750239360:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787784936.262168:0:22649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784936.262287:0:22649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa99ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787784936.262605:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750239360 00000100:00100000:3.0:1787784936.262612:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750239360 00000100:00100000:3.0:1787784936.262725:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787784936.262737:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+5:22649:x1874627750239360:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784936.262749:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784936.262764:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c0030e00/0x88ace7295d9e717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e710 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.262994:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c0030e00/0x88ace7295d9e717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e710 expref: 6 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.263015:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c0030e00/0x88ace7295d9e717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e710 expref: 6 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.263024:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c0030e00, rc 0) 00000100:00100000:3.0:1787784936.263079:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+6:22649:x1874627750239360:12345-0@lo:101:mount.lustre.0 Request processed in 345us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784936.263086:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784936.263170:0:22649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe5b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750239360:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784936.263183:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e717 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784936.263192:0:22649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e717 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784936.263279:0:22649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe5b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750239488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784936.263307:0:22649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784936.263336:0:22649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa99ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787784936.263395:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750239488 00000100:00100000:3.0:1787784936.263399:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750239488 00000100:00100000:3.0:1787784936.263432:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787784936.263439:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+6:22649:x1874627750239488:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784936.263649:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+6:22649:x1874627750239488:12345-0@lo:501:mount.lustre.0 Request processed in 210us (340us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787784936.263665:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787784936.263831:0:22649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe5b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750239488:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787784936.263859:0:22649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787784936.263905:0:22649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e717 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784936.263914:0:22649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e717 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784936.263923:0:22649:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8951ff20c000 10000000:01000000:1.0:1787784936.263928:0:22649:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787784936.263933:0:22649:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8951ff20c000 10000000:01000000:1.0:1787784936.263941:0:22649:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787784936.263945:0:22649:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8951ff20c000 from 1 10000000:01000000:1.0:1787784936.263947:0:22649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787784936.263968:0:22649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df603a00/0x88ace7295d9e71e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784936.263976:0:22649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951df603a00/0x88ace7295d9e71e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784936.263983:0:22649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951df603a00/0x88ace7295d9e71e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784936.263996:0:22649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750239616:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787784936.264037:0:22649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784936.264058:0:22649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787784936.264120:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750239616 00000100:00100000:3.0:1787784936.264125:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750239616 00000100:00100000:3.0:1787784936.264157:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787784936.264164:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+6:22649:x1874627750239616:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784936.264171:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784936.264180:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c0031c00/0x88ace7295d9e725 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e71e expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.264196:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c0031c00/0x88ace7295d9e725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e71e expref: 7 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.264205:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c0031c00/0x88ace7295d9e725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e71e expref: 7 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.264212:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c0031c00, rc 0) 00000100:00100000:3.0:1787784936.264239:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+7:22649:x1874627750239616:12345-0@lo:101:mount.lustre.0 Request processed in 75us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784936.264244:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787784936.264321:0:22649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750239616:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784936.264332:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951df603a00/0x88ace7295d9e71e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e725 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784936.264339:0:22649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951df603a00/0x88ace7295d9e71e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e725 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784936.264351:0:22649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787784936.264588:0:22649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df603a00/0x88ace7295d9e71e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e725 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784936.264597:0:22649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951df603a00/0x88ace7295d9e71e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e725 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784936.264603:0:22649:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787784936.264675:0:22649:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787784936.264681:0:22649:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8951ff20c000 10000000:01000000:3.0:1787784936.264684:0:22649:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787784936.264687:0:22649:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787784936.264690:0:22649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787784936.264705:0:22649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9e72c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.264712:0:22649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9e72c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.264719:0:22649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9e72c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784936.264737:0:22649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750239744:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787784936.264764:0:22649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784936.264814:0:22649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d13a5180 going to sleep for 11 seconds 00000100:00100000:0.0:1787784936.264956:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750239744 00000100:00100000:0.0:1787784936.264960:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750239744 00000100:00100000:0.0:1787784936.264992:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784936.265009:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+7:22649:x1874627750239744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784936.265017:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784936.265033:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d34c00/0x88ace7295d9e733 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e72c expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784936.265048:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d34c00/0x88ace7295d9e733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e72c expref: 8 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784936.265055:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d34c00/0x88ace7295d9e733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e72c expref: 8 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784936.265061:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d34c00, rc 0) 00000100:00100000:0.0:1787784936.265092:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+8:22649:x1874627750239744:12345-0@lo:101:mount.lustre.0 Request processed in 94us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784936.265098:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784936.265169:0:22649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750239744:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784936.265180:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9e72c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e733 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784936.265188:0:22649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9e72c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e733 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784936.265237:0:22649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750239872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784936.265262:0:22649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784936.265288:0:22649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787784936.265335:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750239872 00000100:00100000:0.0:1787784936.265339:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750239872 00000100:00100000:0.0:1787784936.265367:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787784936.265374:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+8:22649:x1874627750239872:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784936.265501:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+9:22649:x1874627750239872:12345-0@lo:501:mount.lustre.0 Request processed in 126us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784936.265507:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787784936.265626:0:22649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750239872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784936.265651:0:22649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750240000:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784936.265701:0:22649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784936.265721:0:22649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784936.265737:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750240000 00000100:00100000:1.0:1787784936.265740:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750240000 00000100:00100000:1.0:1787784936.265759:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787784936.265765:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+9:22649:x1874627750240000:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784936.266924:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+9:22649:x1874627750240000:12345-0@lo:503:mount.lustre.0 Request processed in 1154us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784936.266934:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787784936.267038:0:22649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750240000:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784936.267497:0:22687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e11354d-250d-4393-8e0e-7593eb008ce7:22687:1874627750240128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784936.267541:0:22687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784936.267576:0:22687:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95d240 going to sleep for 11 seconds 00000100:00100000:0.0:1787784936.267626:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750240128 00000100:00100000:0.0:1787784936.267631:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750240128 00000100:00100000:0.0:1787784936.267672:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787784936.267691:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+9:22687:x1874627750240128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784936.268492:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+9:22687:x1874627750240128:12345-0@lo:502:llog_process_th.0 Request processed in 809us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784936.268501:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787784936.268581:0:22687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e11354d-250d-4393-8e0e-7593eb008ce7:22687:1874627750240128:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787784936.268615:0:22687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784936.268627:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784936.268629:0:22687:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787784936.268635:0:22687:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787784936.268637:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787784936.268650:0:22687:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8951ebd50000) 00000020:00000080:1.0:1787784936.268676:0:22687:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787784936.268681:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787784936.268762:0:22687:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787784936.268804:0:22687:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9e741 00000020:00000080:1.0:1787784936.269016:0:22687:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787784936.269020:0:22687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784936.269024:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784936.269026:0:22687:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787784936.269029:0:22687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784936.269032:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784936.269033:0:22687:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787784936.269036:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787784936.269051:0:22687:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8951cfedcd28) 00000020:00000080:1.0:1787784936.269060:0:22687:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787784936.269065:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787784936.269067:0:22687:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787784936.269070:0:22687:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787784936.269075:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787784936.269113:0:22687:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951ff20c000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787784936.269126:0:22687:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8951cfed8000) 00000020:00000080:1.0:1787784936.269132:0:22687:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787784936.269185:0:22687:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787784936.269191:0:22687:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88ace7295d9e756 00000020:00000080:1.0:1787784936.269272:0:22687:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787784936.269278:0:22687:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787784936.269282:0:22687:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x88ace7295d9e75d 00080000:01000000:1.0:1787784936.269286:0:22687:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787784936.269295:0:22687:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9e764 00010000:00010000:1.0:1787784936.366988:0:22687:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1787784936.368125:0:22687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:1.0:1787784936.369070:0:22687:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787784936.369517:0:22687:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8951cfed99b8) 00000020:00000080:1.0:1787784936.369538:0:22687:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787784936.369606:0:22687:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787784936.369613:0:22687:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9e772 00000020:00000080:0.0:1787784936.373288:0:22687:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787784936.388052:0:22687:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x88ace7295d9e779 00000020:00000080:0.0:1787784936.388499:0:22687:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787784936.388511:0:22687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784936.388518:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784936.388520:0:22687:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787784936.388524:0:22687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787784936.388526:0:22687:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1787784936.388528:0:22687:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787784936.388529:0:22687:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787784936.388531:0:22687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787784936.388533:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784936.388535:0:22687:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787784936.388537:0:22687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784936.388542:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784936.388543:0:22687:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787784936.388547:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787784936.388584:0:22687:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787784936.388600:0:22687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784936.388603:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784936.388604:0:22687:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787784936.388607:0:22687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784936.388610:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784936.388611:0:22687:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1787784936.388614:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787784936.388619:0:22687:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:00000080:0.0:1787784936.388642:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787784936.388727:0:22687:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8951fd7b8000) 00000020:00000080:0.0:1787784936.388743:0:22687:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787784936.388750:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787784936.389048:0:22687:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1787784936.389055:0:22687:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787784936.389062:0:22687:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9e787 00010000:00080000:0.0:1787784936.389092:0:22687:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8950c41fe000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:0.0:1787784936.394746:0:22687:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1787784936.401404:0:22687:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787784936.401420:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787784936.401461:0:22687:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787784936.401481:0:22687:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88ace7295d9e78e 00000100:00080000:1.0:1787784936.401491:0:22687:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787784936.401497:0:22687:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8950c41fe000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784936.401531:0:22687:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951d1b5d680 x1874627750240256/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787784936.401559:0:22687:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787784936.401605:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750240256:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1787784936.401611:0:22687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784936.401614:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784936.401615:0:22687:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1787784936.401618:0:22687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787784936.401620:0:22687:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1787784936.401621:0:22687:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787784936.401623:0:22687:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787784936.401624:0:22687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787784936.401626:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784936.401628:0:22687:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787784936.401630:0:22687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787784936.401634:0:22687:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787784936.401637:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784936.401638:0:22687:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787784936.401648:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787784936.401664:0:22687:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000100:00100000:3.0:1787784936.401670:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1787784936.401685:0:22687:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787784936.401688:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787784936.401699:0:22687:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8951cfedb370) 00000020:00000080:1.0:1787784936.401710:0:22687:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787784936.401714:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1787784936.401729:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750240256 00000100:00100000:3.0:1787784936.401735:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750240256 00000100:00100000:3.0:1787784936.401760:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000004:00080000:1.0:1787784936.401797:0:22687:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787784936.401803:0:22687:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787784936.401808:0:22687:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9e79c 00010000:00080000:1.0:1787784936.401833:0:22687:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8950c41fa800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.141@tcp at head 00000100:00100000:3.0:1787784936.401837:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874627750240256:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1787784936.401853:0:22674:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:1.0:1787784936.402037:0:22687:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1787784936.406702:0:22687:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787784936.409305:0:22687:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787784936.412864:0:22687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787784936.414455:0:22687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1787784936.432212:0:22687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1787784936.434752:0:22693:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787784936.434761:0:22693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787784936.439701:0:22687:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787784936.439718:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787784936.439765:0:22687:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787784936.439800:0:22687:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88ace7295d9e7a3 00000100:00080000:0.0:1787784936.439811:0:22687:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787784936.439816:0:22687:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8950c41fa800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784936.439852:0:22687:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fb2561c0 x1874627750240384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784936.439893:0:22687:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787784936.439951:0:22687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784936.439955:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784936.439957:0:22687:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000100:00100000:2.0:1787784936.439959:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb2561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750240384:0@lo:8:llog_process_th.0 00000020:01000000:0.0:1787784936.439960:0:22687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787784936.439963:0:22687:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1787784936.439964:0:22687:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787784936.439965:0:22687:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787784936.439967:0:22687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787784936.439969:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784936.439970:0:22687:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787784936.439972:0:22687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787784936.439976:0:22687:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787784936.439979:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784936.439980:0:22687:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787784936.439995:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787784936.440008:0:22687:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000400:00000100:2.0:1787784936.440022:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627750240384 offset 0 length 520: 4 00000020:01000000:0.0:1787784936.440028:0:22687:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787784936.440031:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787784936.440041:0:22687:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8951fd7bb370) 00000020:00000080:0.0:1787784936.440051:0:22687:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1787784936.440055:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787784936.440111:0:22687:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787784936.440116:0:22687:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1787784936.440123:0:22687:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88ace7295d9e7b1 00010000:00080000:0.0:1787784936.440151:0:22687:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8951f67dc000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:0.0:1787784936.440341:0:22687:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787784936.440407:0:22687:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787784936.440422:0:22687:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787784936.442949:0:22687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784936.443342:0:22687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1787784936.443514:0:22687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000100:00100000:3.0:1787784936.445020:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874627750240256:12345-0@lo:38:llog_process_th.0 Request processed in 43246us (43343us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787784936.445034:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787784936.445040:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c41fe000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787784936.445045:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787784936.445049:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750240256:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787784936.446454:0:22695:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1787784936.446461:0:22695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787784936.447496:0:22687:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787784936.447509:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787784936.447547:0:22687:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787784936.447569:0:22687:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88ace7295d9e7b8 00000100:00080000:1.0:1787784936.447579:0:22687:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787784936.447585:0:22687:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8951f67dc000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784936.447617:0:22687:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951d1b5ed00 x1874627750240512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787784936.447647:0:22687:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1787784936.447751:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750240512:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787784936.447817:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627750240512 offset 0 length 520: 4 00000020:01000000:1.0:1787784936.448391:0:22687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784936.448397:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784936.448398:0:22687:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787784936.448401:0:22687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784936.448405:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784936.448406:0:22687:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787784936.448410:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787784936.448421:0:22687:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787784936.448423:0:22687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784936.448426:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784936.448427:0:22687:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787784936.448430:0:22687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784936.448433:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784936.448434:0:22687:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787784936.448437:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787784936.448468:0:22687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e11354d-250d-4393-8e0e-7593eb008ce7:22687:1874627750240640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784936.448514:0:22687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784936.448546:0:22687:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e6300 going to sleep for 11 seconds 00000100:00100000:0.0:1787784936.449180:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750240640 00000100:00100000:0.0:1787784936.449187:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750240640 00000100:00100000:0.0:1787784936.449235:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787784936.449245:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+9:22687:x1874627750240640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784936.449384:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+9:22687:x1874627750240640:12345-0@lo:502:llog_process_th.0 Request processed in 131us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784936.449392:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787784936.450506:0:22687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e11354d-250d-4393-8e0e-7593eb008ce7:22687:1874627750240640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787784936.450545:0:22687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784936.450553:0:22687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784936.450555:0:22687:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787784936.450559:0:22687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1787784936.450745:0:22649:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1787784936.450804:0:22649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787784936.450822:0:22649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9e72c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e733 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784936.450832:0:22649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951c0031000/0x88ace7295d9e72c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e733 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784936.450841:0:22649:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8951ff20c000 from 1 10000000:01000000:2.0:1787784936.450844:0:22649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787784936.450883:0:22649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628400/0x88ace7295d9e7bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784936.450891:0:22649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1628400/0x88ace7295d9e7bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784936.450900:0:22649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1628400/0x88ace7295d9e7bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784936.450919:0:22649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe5a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750240768:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787784936.450975:0:22649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784936.451008:0:22649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c832d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787784936.451154:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750240768 00000100:00100000:0.0:1787784936.451165:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750240768 00000100:00100000:0.0:1787784936.451208:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787784936.451217:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+9:22649:x1874627750240768:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784936.451228:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784936.451240:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d35600/0x88ace7295d9e7c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e7bf expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784936.451263:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d35600/0x88ace7295d9e7c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e7bf expref: 10 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784936.451273:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d35600/0x88ace7295d9e7c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e7bf expref: 10 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784936.451281:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d35600, rc 0) 00000100:00100000:0.0:1787784936.451314:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+10:22649:x1874627750240768:12345-0@lo:101:mount.lustre.0 Request processed in 99us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784936.451320:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787784936.451547:0:22649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe5a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750240768:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784936.451559:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1628400/0x88ace7295d9e7bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e7c6 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784936.451568:0:22649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1628400/0x88ace7295d9e7bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e7c6 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784936.452220:0:22649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe5a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750240896:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787784936.452260:0:22649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784936.452340:0:22649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c832d900 going to sleep for 11 seconds 00000100:00100000:2.0:1787784936.459015:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750240896 00000100:00100000:2.0:1787784936.459031:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750240896 00000100:00100000:2.0:1787784936.459090:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784936.459100:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+10:22649:x1874627750240896:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787784936.459126:0:22664:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787784936.459131:0:22664:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787784936.459244:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+10:22649:x1874627750240896:12345-0@lo:256:mount.lustre.0 Request processed in 146us (6983us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784936.459252:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784936.459322:0:22649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe5a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750240896:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787784936.460648:0:22649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787784936.460830:0:22649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628400/0x88ace7295d9e7bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e7c6 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784936.460842:0:22649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1628400/0x88ace7295d9e7bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e7c6 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784936.460864:0:22649:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951ff20c000 from 1 10000000:01000000:2.0:1787784936.460867:0:22649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787784936.460978:0:22649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9e7cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784936.460987:0:22649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9e7cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784936.461007:0:22649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9e7cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784936.461032:0:22649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe5a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750241024:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787784936.461100:0:22649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784936.461130:0:22649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c832d900 going to sleep for 11 seconds 00000100:00100000:2.0:1787784936.461153:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750241024 00000100:00100000:2.0:1787784936.461159:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750241024 00000100:00100000:2.0:1787784936.461194:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787784936.461202:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+10:22649:x1874627750241024:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784936.461214:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784936.461228:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1629c00/0x88ace7295d9e7d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e7cd expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784936.461249:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1629c00/0x88ace7295d9e7d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e7cd expref: 11 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784936.461258:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1629c00/0x88ace7295d9e7d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e7cd expref: 11 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784936.461278:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629c00, rc 0) 00000100:00100000:2.0:1787784936.461326:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+11:22649:x1874627750241024:12345-0@lo:101:mount.lustre.0 Request processed in 125us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784936.461333:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787784936.461416:0:22649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe5a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750241024:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784936.461431:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9e7cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e7d4 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.461440:0:22649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9e7cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e7d4 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784936.461504:0:22649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750241152:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784936.461531:0:22649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784936.461543:0:22649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787784936.461661:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750241152 00000100:00100000:0.0:1787784936.461666:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750241152 00000100:00100000:0.0:1787784936.461690:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787784936.461697:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+11:22649:x1874627750241152:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784936.461856:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+11:22649:x1874627750241152:12345-0@lo:501:mount.lustre.0 Request processed in 158us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784936.461863:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787784936.462528:0:22649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750241152:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784936.462583:0:22649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750241280:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787784936.462627:0:22649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784936.462655:0:22649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787784936.462733:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750241280 00000100:00100000:0.0:1787784936.462738:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750241280 00000100:00100000:0.0:1787784936.462799:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787784936.462807:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+11:22649:x1874627750241280:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784936.462919:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+11:22649:x1874627750241280:12345-0@lo:503:mount.lustre.0 Request processed in 113us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784936.462926:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787784936.466413:0:22649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750241280:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787784936.471282:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e11354d-250d-4393-8e0e-7593eb008ce7:22697:1874627750241408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784936.471371:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784936.471423:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4d23480 going to sleep for 11 seconds 00000100:00100000:1.0:1787784936.471481:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750241408 00000100:00100000:1.0:1787784936.471487:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750241408 00000100:00100000:1.0:1787784936.471526:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787784936.471536:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+11:22697:x1874627750241408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784936.472461:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+11:22697:x1874627750241408:12345-0@lo:502:llog_process_th.0 Request processed in 923us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784936.472471:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787784936.472663:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e11354d-250d-4393-8e0e-7593eb008ce7:22697:1874627750241408:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787784936.472696:0:22697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784936.472707:0:22697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784936.472709:0:22697:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787784936.472717:0:22697:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8951ff20c000 00000020:00000080:3.0:1787784936.472720:0:22697:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787784936.472730:0:22697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784936.472732:0:22697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784936.472734:0:22697:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787784936.472736:0:22697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784936.472738:0:22697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784936.472739:0:22697:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787784936.472742:0:22697:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8951ff20c000 00000020:00000080:3.0:1787784936.472744:0:22697:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787784936.472833:0:22697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784936.472837:0:22697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784936.472838:0:22697:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787784936.472840:0:22697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784936.472843:0:22697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784936.472844:0:22697:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787784936.472848:0:22697:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8951ff20c000 00000020:00000080:3.0:1787784936.472857:0:22697:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787784936.474402:0:22697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784936.474412:0:22697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784936.474414:0:22697:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787784936.474418:0:22697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784936.474421:0:22697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784936.474423:0:22697:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787784936.474427:0:22697:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8951ff20c000 00000020:00000080:2.0:1787784936.474429:0:22697:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787784936.474498:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe583c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e11354d-250d-4393-8e0e-7593eb008ce7:22697:1874627750241536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784936.474566:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784936.474608:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c832d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787784936.474759:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750241536 00000100:00100000:3.0:1787784936.474790:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750241536 00000100:00100000:3.0:1787784936.474837:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787784936.474846:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+11:22697:x1874627750241536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784936.475167:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+11:22697:x1874627750241536:12345-0@lo:502:llog_process_th.0 Request processed in 322us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784936.475175:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787784936.477024:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe583c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e11354d-250d-4393-8e0e-7593eb008ce7:22697:1874627750241536:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787784936.477144:0:22697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784936.477154:0:22697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784936.477156:0:22697:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787784936.477161:0:22697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787784936.477321:0:22649:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787784936.477345:0:22649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787784936.477367:0:22649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9e7cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e7d4 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.477387:0:22649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9e7cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e7d4 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784936.477440:0:22649:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787784936.477443:0:22649:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8951ff20c000 10000000:01000000:3.0:1787784936.477446:0:22649:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8951ff20c000 10000000:01000000:3.0:1787784936.477449:0:22649:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787784936.477455:0:22649:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8951ff20c000 from 1 10000000:01000000:3.0:1787784936.477457:0:22649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787784936.477486:0:22649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0030800/0x88ace7295d9e7db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.477494:0:22649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951c0030800/0x88ace7295d9e7db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.477504:0:22649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951c0030800/0x88ace7295d9e7db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784936.477534:0:22649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750241664:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787784936.477586:0:22649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784936.477617:0:22649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951cfeb6900 going to sleep for 11 seconds 00000100:00100000:0.0:1787784936.482847:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750241664 00000100:00100000:0.0:1787784936.482863:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750241664 00000100:00100000:0.0:1787784936.482938:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787784936.482948:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+11:22649:x1874627750241664:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784936.482965:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784936.482984:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d34400/0x88ace7295d9e7e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e7db expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784936.483022:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d34400/0x88ace7295d9e7e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e7db expref: 12 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784936.483033:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d34400/0x88ace7295d9e7e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e7db expref: 12 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784936.483052:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d34400, rc 0) 00000100:00100000:0.0:1787784936.483125:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+12:22649:x1874627750241664:12345-0@lo:101:mount.lustre.0 Request processed in 179us (5540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784936.483132:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787784936.483992:0:22649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750241664:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784936.484026:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951c0030800/0x88ace7295d9e7db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e7e2 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.484037:0:22649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951c0030800/0x88ace7295d9e7db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e7e2 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784936.484111:0:22649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750241792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784936.484152:0:22649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784936.484192:0:22649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951cfeb6900 going to sleep for 11 seconds 00000100:00100000:0.0:1787784936.486336:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750241792 00000100:00100000:0.0:1787784936.486351:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750241792 00000100:00100000:0.0:1787784936.486565:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787784936.486576:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+12:22649:x1874627750241792:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784936.486762:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+12:22649:x1874627750241792:12345-0@lo:501:mount.lustre.0 Request processed in 188us (2608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784936.486787:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787784936.487510:0:22649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750241792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784936.487558:0:22649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750241920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787784936.487607:0:22649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784936.499193:0:22649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951cfeb6900 going to sleep for 11 seconds 00000100:00100000:1.0:1787784936.499747:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750241920 00000100:00100000:1.0:1787784936.499757:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750241920 00000100:00100000:1.0:1787784936.499862:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787784936.499871:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+12:22649:x1874627750241920:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784936.500023:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+12:22649:x1874627750241920:12345-0@lo:503:mount.lustre.0 Request processed in 152us (12415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784936.500045:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787784936.500168:0:22649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750241920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787784936.504889:0:22700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e11354d-250d-4393-8e0e-7593eb008ce7:22700:1874627750242048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784936.504987:0:22700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784936.505048:0:22700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951cfeb69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784936.505075:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750242048 00000100:00100000:3.0:1787784936.505081:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750242048 00000100:00100000:3.0:1787784936.505126:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787784936.505143:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+12:22700:x1874627750242048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784936.505298:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+12:22700:x1874627750242048:12345-0@lo:502:llog_process_th.0 Request processed in 157us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784936.505307:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787784936.505670:0:22700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e11354d-250d-4393-8e0e-7593eb008ce7:22700:1874627750242048:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787784936.505737:0:22700:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787784936.505753:0:22700:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8951fb38b370) 00000020:00000080:3.0:1787784936.505799:0:22700:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1787784936.505948:0:22700:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951ff20c000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787784936.505954:0:22700:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951ff20c000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787784936.505956:0:22700:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951ff20c000 4 00010000:00080000:3.0:1787784936.506017:0:22700:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8951efedf800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:3.0:1787784936.511411:0:22700:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1787784936.511945:0:22700:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787784936.511985:0:22700:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787784936.512010:0:22700:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x88ace7295d9e7f0 00000100:00080000:3.0:1787784936.512022:0:22700:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787784936.512027:0:22700:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8951efedf800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1787784936.512061:0:22700:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fd7c1680 x1874627750242176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787784936.512100:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874627750242176:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787784936.512167:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787784936.512228:0:22700:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787784936.516610:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750242176 00000100:00100000:0.0:1787784936.516626:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750242176 00000100:00100000:0.0:1787784936.516670:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784936.516679:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874627750242176:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787784936.516807:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874627750242176:12345-0@lo:38:llog_process_th.0 Request processed in 126us (4639us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787784936.516814:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784936.516888:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787784936.516897:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951efedf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787784936.516901:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787784936.516905:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874627750242176:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787784936.521207:0:22700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e11354d-250d-4393-8e0e-7593eb008ce7:22700:1874627750242304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784936.521287:0:22700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784936.521326:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750242304 00000100:00100000:3.0:1787784936.521336:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750242304 00000100:00100000:3.0:1787784936.521380:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787784936.521389:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+12:22700:x1874627750242304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784936.521510:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+12:22700:x1874627750242304:12345-0@lo:502:llog_process_th.0 Request processed in 122us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784936.521518:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787784936.521560:0:22700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951cfeb6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784936.521651:0:22700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e11354d-250d-4393-8e0e-7593eb008ce7:22700:1874627750242304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784936.521694:0:22700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e11354d-250d-4393-8e0e-7593eb008ce7:22700:1874627750242432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784936.521724:0:22700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784936.521737:0:22700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951cfeb6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784936.521749:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750242432 00000100:00100000:3.0:1787784936.521752:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750242432 00000100:00100000:3.0:1787784936.521793:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787784936.521801:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+12:22700:x1874627750242432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784936.521860:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+12:22700:x1874627750242432:12345-0@lo:502:llog_process_th.0 Request processed in 60us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784936.521866:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787784936.522036:0:22700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e11354d-250d-4393-8e0e-7593eb008ce7:22700:1874627750242432:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787784936.522057:0:22700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787784936.531733:0:22649:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787784936.531850:0:22649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787784936.531873:0:22649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0030800/0x88ace7295d9e7db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e7e2 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784936.531884:0:22649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951c0030800/0x88ace7295d9e7db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e7e2 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787784936.532037:0:22649:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787784936.532039:0:22649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787784936.532041:0:22649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784936.532042:0:22649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784936.532043:0:22649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784936.532045:0:22649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784936.532046:0:22649:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787784936.532047:0:22649:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787784936.532049:0:22649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784936.532050:0:22649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787784936.532054:0:22649:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787784936.532056:0:22649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787784936.532058:0:22649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787784936.532059:0:22649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784936.532060:0:22649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784936.532061:0:22649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784936.532062:0:22649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784936.532063:0:22649:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787784936.532064:0:22649:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787784936.532065:0:22649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784936.532066:0:22649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787784936.532093:0:22649:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787784936.532115:0:22649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750242560:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787784936.532192:0:22649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784936.532280:0:22649:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784936.536715:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750242560 00000100:00100000:3.0:1787784936.536730:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750242560 00000100:00100000:3.0:1787784936.536809:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787784936.536820:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+12:22649:x1874627750242560:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787784936.536850:0:22663:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787784936.536874:0:22663:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787784936.545720:0:22663:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787784936.545745:0:22663:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787784936.546028:0:22685:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787784936.546034:0:22685:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787784936.546058:0:22685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8951df602c00/0x88ace7295d9e7f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784936.546077:0:22685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951e1d35600/0x88ace7295d9e7c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e7bf expref: 12 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784936.546086:0:22685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8951df602c00/0x88ace7295d9e7f7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784936.546094:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+12:22649:x1874627750242560:12345-0@lo:253:mount.lustre.0 Request processed in 9271us (13898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784936.546107:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1787784936.546128:0:22685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951e1d35600/0x88ace7295d9e7c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9e7bf expref: 11 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784936.546145:0:22685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951e1d35600/0x88ace7295d9e7c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9e7bf expref: 11 pid: 22662 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784936.546159:0:22685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5da40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22685:1874627750242688:0@lo:104: 00000100:00100000:1.0:1787784936.546199:0:22685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784936.546243:0:22685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784936.546284:0:22649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:22649:1874627750242560:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787784936.546295:0:22649:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787784936.546298:0:22649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787784936.546300:0:22649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787784936.546301:0:22649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784936.546302:0:22649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784936.546304:0:22649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784936.546305:0:22649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784936.546306:0:22649:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787784936.546308:0:22649:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787784936.546309:0:22649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784936.546310:0:22649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787784936.546323:0:22649:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1787784936.546554:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750242688 00000100:00100000:3.0:1787784936.546560:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750242688 00000100:00100000:3.0:1787784936.546614:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784936.546622:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+3:22685:x1874627750242688:12345-0@lo:104: 00010000:00010000:3.0:1787784936.546634:0:22653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951d1628400/0x88ace7295d9e7bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e7c6 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.546689:0:22653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787784936.546695:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+3:22685:x1874627750242688:12345-0@lo:104: Request processed in 74us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784936.546702:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784936.546730:0:22685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5da40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22685:1874627750242688:0@lo:104: 00010000:00010000:3.0:1787784936.546745:0:22685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8951df602c00/0x88ace7295d9e7f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784936.549206:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784936.549219:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951d1628400/0x88ace7295d9e7bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e7c6 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784936.549232:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628400 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784936.549236:0:22659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628400/0x88ace7295d9e7bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9e7c6 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784936.549246:0:22659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951d1628400/0x88ace7295d9e7bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9e7c6 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784936.549252:0:22659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628400/0x88ace7295d9e7bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9e7c6 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784936.549278:0:22659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784936.549341:0:22659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951d1628400/0x88ace7295d9e7bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e7c6 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784936.549349:0:22659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784936.549372:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951d1628400/0x88ace7295d9e7bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e7c6 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784936.549380:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951d1628400/0x88ace7295d9e7bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e7c6 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784936.549402:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784936.549404:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784936.549406:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784936.550119:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784936.550137:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e11354d-250d-4393-8e0e-7593eb008ce7:3645:1874627750242816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784936.550197:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784936.550260:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750242816 00000100:00100000:3.0:1787784936.550268:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750242816 00010000:00010000:3.0:1787784936.550298:0:22655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951e1d35600/0x88ace7295d9e7c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e7bf expref: 12 pid: 22662 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784936.550339:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784936.550349:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb256940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+12:3645:x1874627750242816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784936.550362:0:22655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784936.550376:0:22655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951e1d35600/0x88ace7295d9e7c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e7bf expref: 12 pid: 22662 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.550390:0:22655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951e1d35600/0x88ace7295d9e7c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9e7bf expref: 12 pid: 22662 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.550406:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d35600/0x88ace7295d9e7c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9e7bf expref: 12 pid: 22662 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.550422:0:22655:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8951df602c00/0x88ace7295d9e7f7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.550430:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df602c00/0x88ace7295d9e7f7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787784936.551684:0:22655:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005650253s 00010000:00010000:3.0:1787784936.551691:0:22655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951df602c00/0x88ace7295d9e7f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.551699:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951df602c00/0x88ace7295d9e7f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.551707:0:22655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8951df602c00/0x88ace7295d9e7f7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.551713:0:22655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8951df602c00/0x88ace7295d9e7f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.551720:0:22655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602c00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784936.551724:0:22655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8951df602c00/0x88ace7295d9e7f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.551732:0:22655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8951df602c00/0x88ace7295d9e7f7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.551781:0:22655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8951df602c00/0x88ace7295d9e7f7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784936.551794:0:22655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787784936.551823:0:22685:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8951df602c00/0x88ace7295d9e7f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784936.551844:0:22685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8951df602c00/0x88ace7295d9e7f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784936.551853:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb256940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+11:3645:x1874627750242816:12345-0@lo:103:ldlm_bl.0 Request processed in 1504us (1653us total) trans 0 rc 0/0 00010000:00010000:0.0:1787784936.551855:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df602c00/0x88ace7295d9e7f7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784936.551870:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784936.553120:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e11354d-250d-4393-8e0e-7593eb008ce7:3645:1874627750242816:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787784936.568146:0:22649:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:1.0:1787784936.568513:0:22649:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787784936.569006:0:22709:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:0.0:1787784936.569011:0:22709:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:2.0:1787784936.569694:0:22710:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1787784936.570357:0:22710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1787784936.570799:0:22649:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:0.0:1787784936.571918:0:22711:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8951fb254f00 x1874627750242944/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784936.571932:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81decc0 going to sleep for 0 seconds 00000040:01000000:1.0:1787784936.572453:0:22649:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787784936.572456:0:22710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:00080000:1.0:1787784936.572488:0:22649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1787784936.572518:0:22710:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:1.0:1787784936.573524:0:22649:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787784936.577989:0:22649:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787784936.578108:0:22649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787784936.580404:0:22649:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787784936.581039:0:22649:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787784936.581084:0:22649:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787784936.586160:0:22649:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1787784936.586730:0:22649:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:0.0:1787784936.589423:0:22649:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1787784936.604066:0:22649:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787784936.604106:0:22649:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb77a0147b988 00100000:10000000:1.0:1787784936.604290:0:22649:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787784936.610374:0:22649:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787784936.610391:0:22649:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.141@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787784936.610411:0:22649:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787784936.610449:0:22649:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787784936.612719:0:22649:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787784936.612988:0:22649:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787784937.094843:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787784937.612612:0:22705:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787784937.612622:0:22705:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1787784937.613370:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81decc0 going to sleep for 0 seconds 00000040:00080000:3.0:1787784937.616121:0:22705:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787784937.616137:0:22705:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:1.0:1787784937.928512:0:22668:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787784937.928521:0:22668:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8951ff20c000 from 11 10000000:01000000:1.0:1787784937.928528:0:22668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787784937.928593:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df603c00/0x88ace7295d9e7fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784937.928604:0:22668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951df603c00/0x88ace7295d9e7fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784937.928617:0:22668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951df603c00/0x88ace7295d9e7fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784937.928644:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750243072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787784937.928722:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784937.928800:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c345f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784937.929406:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750243072 00000100:00100000:3.0:1787784937.929414:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750243072 00000100:00100000:3.0:1787784937.929473:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787784937.929483:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+11:22668:x1874627750243072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784937.929498:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784937.929513:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c0030200/0x88ace7295d9e805 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e7fe expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784937.929538:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c0030200/0x88ace7295d9e805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e7fe expref: 12 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784937.929547:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c0030200/0x88ace7295d9e805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e7fe expref: 12 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784937.929556:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c0030200, rc 0) 00000100:00100000:3.0:1787784937.929624:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+12:22668:x1874627750243072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784937.929631:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787784937.929661:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750243072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784937.929693:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951df603c00/0x88ace7295d9e7fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e805 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784937.929715:0:22668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951df603c00/0x88ace7295d9e7fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e805 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784937.929796:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750243200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787784937.929832:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784937.929856:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c345f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784937.930042:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750243200 00000100:00100000:3.0:1787784937.930047:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750243200 00000100:00100000:3.0:1787784937.930079:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787784937.930086:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+12:22668:x1874627750243200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787784937.930100:0:22663:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787784937.930116:0:22663:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787784937.930119:0:22663:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1787784937.930311:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+12:22668:x1874627750243200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 225us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784937.930318:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787784937.930320:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750243200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787784937.930364:0:22668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787784937.930371:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df603c00/0x88ace7295d9e7fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e805 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784937.930380:0:22668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951df603c00/0x88ace7295d9e7fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e805 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784938.118207:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784938.630115:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81decc0 going to sleep for 0 seconds 00000040:00080000:3.0:1787784938.632704:0:22705:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787784938.632720:0:22705:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787784938.632933:0:22705:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:3.0:1787784938.633330:0:22705:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787784938.633537:0:22705:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:3.0:1787784939.143013:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784939.653934:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81decc0 going to sleep for 0 seconds 00010000:00010000:2.0:1787784940.165997:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784940.677827:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81decc0 going to sleep for 0 seconds 00010000:00010000:3.0:1787784941.190657:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784941.702013:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81decc0 going to sleep for 0 seconds 00000100:00080000:2.0:1787784941.702531:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787784941.702536:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787784941.702539:0:37:0:(import.c:65:import_set_state_nolock()) ffff8950c41fe000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787784941.702547:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 676 00000100:00080000:2.0:1787784941.702553:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787784941.702568:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8950c41fe000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784941.702593:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fbe59a40 x1874627750243456/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787784941.702621:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784941.702625:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784941.702628:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784941.702631:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784941.702634:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787784941.702638:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787784941.702639:0:37:0:(import.c:65:import_set_state_nolock()) ffff8951efedf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787784941.702644:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8951efedf800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784941.702658:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fbe59e00 x1874627750243584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787784941.702683:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e11354d-250d-4393-8e0e-7593eb008ce7:3645:1874627750243328:0@lo:400:kworker.0 00000100:00100000:2.0:1787784941.702752:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784941.702848:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750243328 00000100:00100000:2.0:1787784941.702855:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750243328 00000100:00100000:2.0:1787784941.702900:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787784941.702909:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+12:3645:x1874627750243328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784941.702969:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+12:3645:x1874627750243328:12345-0@lo:400:kworker.0 Request processed in 59us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784941.702976:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787784941.703010:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750243456:0@lo:38:kworker.0 00000100:00100000:2.0:1787784941.703040:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784941.703065:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874627750243584:0@lo:38:kworker.0 00000100:00100000:2.0:1787784941.703090:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784941.703138:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750243456 00000100:00100000:2.0:1787784941.703143:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750243456 00000100:00100000:2.0:1787784941.703162:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784941.703167:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbe592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874627750243456:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787784941.703182:0:22675:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787784941.703214:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbe592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874627750243456:12345-0@lo:38:kworker.0 Request processed in 46us (173us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787784941.703221:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784941.703255:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e11354d-250d-4393-8e0e-7593eb008ce7:3645:1874627750243328:0@lo:400:kworker.0 00000100:00080000:2.0:1787784941.703281:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c41fe000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784941.703285:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787784941.703287:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750243456:0@lo:38:kworker.0 00000100:00100000:1.0:1787784941.703501:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750243584 00000100:00100000:1.0:1787784941.703506:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750243584 00000100:00100000:1.0:1787784941.703528:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784941.703533:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbe5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1874627750243584:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787784941.703549:0:22671:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:1.0:1787784941.703580:0:22671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x88ace7295d9e80c 00000004:00100000:1.0:1787784941.703594:0:22671:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787784941.703737:0:22671:0:(import.c:65:import_set_state_nolock()) ffff8950c35a8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784941.703802:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbe5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1874627750243584:12345-0@lo:38:kworker.0 Request processed in 267us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784941.703809:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787784941.703862:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8951fbe59e00 x1874627750243584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787784941.703874:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1787784941.703880:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787784941.703884:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787784941.703886:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951efedf800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787784941.703890:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1874627750243584:0@lo:38:kworker.0 00000001:02000400:2.0:1787784941.810433:0:22955:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787784942.214087:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787784942.655095:0:23007:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787784942.655299:0:23007:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787784942.726033:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81decc0 going to sleep for 0 seconds 00010000:00010000:2.0:1787784943.244259:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787784943.608079:0:23057:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787784943.608288:0:23057:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787784943.751316:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81decc0 going to sleep for 0 seconds 00010000:00010000:0.0:1787784944.267910:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784944.774112:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81decc0 going to sleep for 0 seconds 00010000:00010000:2.0:1787784945.286400:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784945.800372:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81decc0 going to sleep for 0 seconds 00010000:00010000:0.0:1787784946.310099:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784946.825809:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81decc0 going to sleep for 0 seconds 00000100:00080000:1.0:1787784946.832656:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787784946.832663:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787784946.832667:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8950c41fe000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787784946.832675:0:15021:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 681 00000100:00080000:1.0:1787784946.832682:0:15021:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787784946.832688:0:15021:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8950c41fe000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784946.832712:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951d1b5cb40 x1874627750243840/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787784946.832724:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784946.832728:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784946.832731:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784946.832734:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787784946.832826:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e11354d-250d-4393-8e0e-7593eb008ce7:3646:1874627750243712:0@lo:400:kworker.0 00000100:00100000:1.0:1787784946.832920:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784946.832980:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784946.832986:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750243968:0@lo:400:kworker.0 00000100:00100000:1.0:1787784946.833014:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784946.833078:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750243712 00000100:00100000:1.0:1787784946.833085:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750243712 00000100:00100000:1.0:1787784946.833127:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787784946.833136:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+12:3646:x1874627750243712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784946.833187:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+12:3646:x1874627750243712:12345-0@lo:400:kworker.0 Request processed in 51us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784946.833194:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787784946.833231:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750243968 00000100:00100000:1.0:1787784946.833235:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750243968 00000100:00100000:1.0:1787784946.833260:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784946.833265:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750243968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784946.833296:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750243968:12345-0@lo:400:kworker.0 Request processed in 31us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784946.833302:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787784946.833335:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8951d1b5e940 x1874627750243968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784946.833347:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750243968:0@lo:400:kworker.0 00000100:00100000:1.0:1787784946.833613:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e11354d-250d-4393-8e0e-7593eb008ce7:3646:1874627750243712:0@lo:400:kworker.0 00000100:00100000:3.0:1787784946.836804:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784936/real 1787784936] req@ffff8951d1b5ed00 x1874627750240512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784946 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784946.836835:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8951d1b5ed00 x1874627750240512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784946 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784946.836847:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784936/real 1787784936] req@ffff8951fb2561c0 x1874627750240384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784946 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784946.836868:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8951fb2561c0 x1874627750240384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784946 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784946.836892:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750243840:0@lo:38:kworker.0 00000100:00100000:3.0:1787784946.836966:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787784946.837005:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951f67dc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787784946.837021:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787784946.837025:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750240512:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787784946.837031:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c41fa800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787784946.837035:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787784946.837038:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb2561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750240384:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1787784946.840250:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750243840 00000100:00100000:2.0:1787784946.840267:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750243840 00000100:00100000:2.0:1787784946.840318:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784946.840326:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874627750243840:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787784946.840345:0:22675:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787784946.840435:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874627750243840:12345-0@lo:38:kworker.0 Request processed in 108us (3469us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787784946.840443:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787784946.840492:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c41fe000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784946.840497:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787784946.840501:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750243840:0@lo:38:kworker.0 00000100:00080000:1.0:1787784946.842060:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784946.842070:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787784946.842074:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8950c41fa800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787784946.842080:0:15021:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 676 00000100:00080000:1.0:1787784946.842086:0:15021:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787784946.842094:0:15021:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8950c41fa800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784946.842129:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951d1b5fc00 x1874627750244096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787784946.842158:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784946.842161:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787784946.842163:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8951f67dc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787784946.842166:0:15021:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 676 00000100:00080000:1.0:1787784946.842169:0:15021:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787784946.842173:0:15021:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8951f67dc000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784946.842185:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951d1b5e940 x1874627750244224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787784946.843449:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750244096:0@lo:8:kworker.0 00000400:00000100:2.0:1787784946.843503:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627750244096 offset 0 length 520: 4 00000100:00100000:2.0:1787784946.843539:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750244224:0@lo:8:kworker.0 00000400:00000100:2.0:1787784946.843560:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627750244224 offset 0 length 520: 4 00010000:00010000:2.0:1787784947.333992:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784947.852708:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81decc0 going to sleep for 0 seconds 00010000:00010000:0.0:1787784948.361380:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784948.873007:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81decc0 going to sleep for 0 seconds 00000040:00080000:3.0:1787784948.874549:0:22705:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787784949.382060:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784949.895146:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81decc0 going to sleep for 0 seconds 00010000:00010000:1.0:1787784950.438928:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784950.917893:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81decc0 going to sleep for 0 seconds 00000020:01000004:0.0:1787784951.246641:0:23403:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787784951.246647:0:23403:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787784951.246649:0:23403:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787784951.260993:0:23403:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8951f81b5800 00000020:01000004:1.0:1787784951.261026:0:23403:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1787784951.261045:0:23403:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787784951.261094:0:23403:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff895201b88000) 00000020:00000080:1.0:1787784951.261117:0:23403:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787784951.434105:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787784951.434455:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1787784951.436161:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1787784951.437194:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787784951.440438:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787784951.441020:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1787784951.441359:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787784951.441644:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787784951.441984:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787784951.442270:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787784951.442603:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787784951.443253:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787784951.443525:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1787784951.443748:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787784951.445903:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787784951.446614:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1787784951.447082:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1787784951.447939:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1787784951.448439:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787784951.449211:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1787784951.450150:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787784951.450479:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787784951.450753:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1787784951.451333:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1787784951.451674:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1787784951.452097:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1787784951.452481:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1787784951.453173:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1787784951.453927:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1787784951.454408:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1787784951.454683:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1787784951.455213:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1787784951.456151:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1787784951.457067:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1787784951.458277:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1787784951.458656:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1787784951.460218:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1787784951.461126:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1787784951.461596:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1787784951.464163:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1787784951.466747:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1787784951.468613:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1787784951.471314:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1787784951.471967:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1787784951.472614:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1787784951.472955:0:23403:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00080000:01000000:0.0:1787784951.486056:0:23403:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787784951.486380:0:23403:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1787784951.486396:0:23403:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787784951.486414:0:23403:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x88ace7295d9e81a 00000020:01000004:0.0:1787784951.486425:0:23403:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787784951.486455:0:23403:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.141@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787784951.486460:0:23403:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787784951.486468:0:23403:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1787784951.486523:0:23403:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1787784951.486528:0:23403:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.141@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00010000:00010000:1.0:1787784951.494229:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787784951.498301:0:23403:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787784951.498376:0:23403:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.141@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1787784951.498383:0:23403:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787784951.498385:0:23403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787784951.498387:0:23403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784951.498388:0:23403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784951.498390:0:23403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784951.498391:0:23403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784951.498392:0:23403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787784951.498395:0:23403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784951.498397:0:23403:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787784951.498401:0:23403:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1787784951.498403:0:23403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787784951.498405:0:23403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787784951.498406:0:23403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784951.498408:0:23403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784951.498408:0:23403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784951.498416:0:23403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784951.498417:0:23403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787784951.498417:0:23403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784951.498418:0:23403:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787784951.498456:0:23403:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787784951.498486:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750244352:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787784951.501402:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784951.501493:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c3de7600 going to sleep for 11 seconds 00000100:00100000:1.0:1787784951.502059:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750244352 00000100:00100000:1.0:1787784951.502073:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750244352 00000100:00100000:1.0:1787784951.502149:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787784951.502161:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+12:23403:x1874627750244352:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787784951.502212:0:22664:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787784951.502216:0:22664:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1787784951.502227:0:22664:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787784951.503074:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+12:23403:x1874627750244352:12345-0@lo:253:mount.lustre.0 Request processed in 910us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784951.503087:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787784951.503218:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750244352:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787784951.503237:0:23403:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787784951.503241:0:23403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787784951.503243:0:23403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787784951.503245:0:23403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784951.503246:0:23403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784951.503248:0:23403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784951.503249:0:23403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784951.503250:0:23403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787784951.503253:0:23403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784951.503254:0:23403:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787784951.503277:0:23403:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8951f81b5800 from lustre-MDT0001 10000000:01000000:2.0:1787784951.503315:0:23403:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787784951.503319:0:23403:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787784951.503328:0:23403:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8951ebd519b8 local copy 00010000:00010000:2.0:1787784951.503342:0:23403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e717 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784951.503487:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750244480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784951.503545:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784951.503584:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e6900 going to sleep for 11 seconds 00000100:00100000:1.0:1787784951.503697:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750244480 00000100:00100000:1.0:1787784951.503712:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750244480 00000100:00100000:1.0:1787784951.503761:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787784951.503798:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+12:23403:x1874627750244480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784951.504072:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+12:23403:x1874627750244480:12345-0@lo:501:mount.lustre.0 Request processed in 276us (527us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787784951.504081:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787784951.504167:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750244480:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787784951.504181:0:23403:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787784951.504202:0:23403:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787784951.504216:0:23403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e717 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784951.504226:0:23403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e717 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784951.504261:0:23403:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8951f81b5800 10000000:01000000:2.0:1787784951.504266:0:23403:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787784951.504272:0:23403:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8951ebd519b8 10000000:01000000:2.0:1787784951.504275:0:23403:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787784951.504279:0:23403:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8951ebd519b8 from 1 10000000:01000000:2.0:1787784951.504283:0:23403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787784951.504312:0:23403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628600/0x88ace7295d9e821 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784951.504322:0:23403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1628600/0x88ace7295d9e821 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784951.504332:0:23403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1628600/0x88ace7295d9e821 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784951.504346:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750244608:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787784951.504376:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784951.504408:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e6900 going to sleep for 11 seconds 00000100:00100000:1.0:1787784951.504463:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750244608 00000100:00100000:1.0:1787784951.504468:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750244608 00000100:00100000:1.0:1787784951.504510:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787784951.504651:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+12:23403:x1874627750244608:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784951.504662:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784951.504678:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df602400/0x88ace7295d9e828 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e821 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.504977:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df602400/0x88ace7295d9e828 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e821 expref: 13 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.504991:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df602400/0x88ace7295d9e828 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e821 expref: 13 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.505001:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602400, rc 0) 00000100:00100000:1.0:1787784951.505090:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+13:23403:x1874627750244608:12345-0@lo:101:mount.lustre.0 Request processed in 571us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784951.505098:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787784951.510105:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750244608:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784951.510143:0:23403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1628600/0x88ace7295d9e821 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e828 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784951.510158:0:23403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1628600/0x88ace7295d9e821 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e828 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784951.510213:0:23403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787784951.510311:0:23403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628600/0x88ace7295d9e821 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e828 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784951.510320:0:23403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1628600/0x88ace7295d9e821 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e828 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784951.510335:0:23403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8951f81b5800 10000000:01000000:3.0:1787784951.511986:0:23403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787784951.512002:0:23403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8951f81b5800 from 1 10000000:01000000:3.0:1787784951.512006:0:23403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787784951.512062:0:23403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9e82f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784951.512074:0:23403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9e82f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784951.512086:0:23403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9e82f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784951.512116:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750244736:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787784951.512216:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784951.512280:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951e0bf9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784951.512359:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750244736 00000100:00100000:2.0:1787784951.512369:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750244736 00000100:00100000:2.0:1787784951.512440:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787784951.512452:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+13:23403:x1874627750244736:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784951.512469:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784951.512484:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1628e00/0x88ace7295d9e836 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e82f expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784951.512511:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1628e00/0x88ace7295d9e836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e82f expref: 14 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784951.512535:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1628e00/0x88ace7295d9e836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e82f expref: 14 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784951.512544:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628e00, rc 0) 00000100:00100000:2.0:1787784951.512610:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+14:23403:x1874627750244736:12345-0@lo:101:mount.lustre.0 Request processed in 160us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784951.512618:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787784951.512875:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750244736:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784951.512895:0:23403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9e82f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e836 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784951.512907:0:23403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9e82f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e836 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784951.512933:0:23403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787784951.516144:0:23403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9e82f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e836 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784951.516171:0:23403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951c0031400/0x88ace7295d9e82f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e836 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784951.516182:0:23403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787784951.516265:0:23403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787784951.516277:0:23403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8951f81b5800 10000000:01000000:1.0:1787784951.516281:0:23403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787784951.516287:0:23403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1787784951.516311:0:23403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787784951.516364:0:23403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df602200/0x88ace7295d9e83d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.516374:0:23403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951df602200/0x88ace7295d9e83d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.516390:0:23403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951df602200/0x88ace7295d9e83d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784951.516426:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750244864:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787784951.516539:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784951.516595:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951e0be1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784951.516661:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750244864 00000100:00100000:2.0:1787784951.516680:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750244864 00000100:00100000:2.0:1787784951.516765:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787784951.516827:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+14:23403:x1874627750244864:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784951.516856:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784951.516880:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1629800/0x88ace7295d9e844 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e83d expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784951.516915:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1629800/0x88ace7295d9e844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e83d expref: 15 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784951.516928:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1629800/0x88ace7295d9e844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e83d expref: 15 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784951.516939:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629800, rc 0) 00000100:00100000:2.0:1787784951.517003:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+15:23403:x1874627750244864:12345-0@lo:101:mount.lustre.0 Request processed in 178us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784951.517011:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787784951.517327:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750244864:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784951.517346:0:23403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951df602200/0x88ace7295d9e83d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e844 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784951.517364:0:23403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951df602200/0x88ace7295d9e83d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e844 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787784951.519631:0:23403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1787784951.521303:0:23403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784951.540234:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787784951.540323:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1787784951.540342:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1787784951.540355:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1787784951.540367:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1787784951.540381:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1787784951.540394:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1787784951.540407:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1787784951.540425:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1787784951.540437:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1787784951.540449:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1787784951.540462:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1787784951.540473:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1787784951.540486:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1787784951.540498:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1787784951.540510:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1787784951.540521:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1787784951.540532:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1787784951.540543:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1787784951.540554:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1787784951.540565:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1787784951.540577:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1787784951.540590:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1787784951.540604:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1787784951.540619:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1787784951.540632:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1787784951.540658:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1787784951.540671:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1787784951.540685:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1787784951.540698:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1787784951.540709:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1787784951.540721:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1787784951.540734:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1787784951.540747:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1787784951.540760:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1787784951.540839:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1787784951.540853:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1787784951.540895:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1787784951.540912:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1787784951.540924:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1787784951.540936:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1787784951.540948:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1787784951.540959:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1787784951.540971:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1787784951.540999:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1787784951.541003:0:23403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1787784951.541175:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750244992:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784951.542713:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784951.543093:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750244992 00000100:00100000:1.0:1787784951.543106:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750244992 00000100:00100000:1.0:1787784951.543178:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787784951.543192:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+15:23403:x1874627750244992:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784951.543404:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+15:23403:x1874627750244992:12345-0@lo:501:mount.lustre.0 Request processed in 215us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784951.543412:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787784951.543560:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951e0bf9480 going to sleep for 11 seconds 00000100:00100000:3.0:1787784951.543596:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750244992:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784951.543675:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750245120:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787784951.543753:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784951.543797:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951e0bf9480 going to sleep for 11 seconds 00000100:00100000:1.0:1787784951.544014:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750245120 00000100:00100000:1.0:1787784951.544020:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750245120 00000100:00100000:1.0:1787784951.544063:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787784951.544072:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+15:23403:x1874627750245120:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784951.548086:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+15:23403:x1874627750245120:12345-0@lo:503:mount.lustre.0 Request processed in 4004us (4323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784951.548101:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787784951.549289:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750245120:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787784951.550045:0:23403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787784951.550171:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750245248:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784951.550265:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784951.552548:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951e0bf93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784951.556188:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750245248 00000100:00100000:2.0:1787784951.556212:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750245248 00000100:00100000:2.0:1787784951.556344:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787784951.556358:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+15:23403:x1874627750245248:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784951.563316:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+15:23403:x1874627750245248:12345-0@lo:502:mount.lustre.0 Request processed in 6945us (13034us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784951.563337:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787784951.563513:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750245248:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787784951.564002:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1787784951.564041:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1787784951.564056:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1787784951.564070:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1787784951.564087:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1787784951.564100:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1787784951.564113:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1787784951.564127:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1787784951.564140:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1787784951.564154:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1787784951.564167:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1787784951.564181:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1787784951.564194:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1787784951.564208:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1787784951.564219:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1787784951.564231:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1787784951.564243:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1787784951.564256:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1787784951.564269:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1787784951.564283:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1787784951.564295:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1787784951.564308:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1787784951.564323:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1787784951.564337:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1787784951.564349:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1787784951.564361:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1787784951.564374:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1787784951.564389:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1787784951.564400:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1787784951.564413:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1787784951.564426:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1787784951.564439:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1787784951.564466:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1787784951.564479:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1787784951.564490:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1787784951.564502:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1787784951.564514:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1787784951.564527:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1787784951.564540:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1787784951.564554:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1787784951.564567:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1787784951.564579:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1787784951.564596:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1787784951.564609:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1787784951.564663:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750245376:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784951.564746:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784951.572785:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750245376 00000100:00100000:3.0:1787784951.572807:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750245376 00000100:00100000:1.0:1787784951.573762:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c3d46e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787784951.576399:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787784951.576419:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+15:23403:x1874627750245376:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784951.576752:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+15:23403:x1874627750245376:12345-0@lo:502:mount.lustre.0 Request processed in 336us (12005us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784951.576763:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787784951.581447:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750245376:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787784951.581642:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1787784951.581660:0:23403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1787784951.584713:0:23408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784951.584733:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784951.584735:0:23408:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787784951.584744:0:23408:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787784951.584748:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787784951.584797:0:23408:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff895201b899b8) 00000020:00000080:1.0:1787784951.584827:0:23408:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1787784951.584834:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787784951.584965:0:23408:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787784951.584972:0:23408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x88ace7295d9e852 00000020:00000080:1.0:1787784951.585323:0:23408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787784951.585329:0:23408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784951.585333:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784951.585335:0:23408:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787784951.585337:0:23408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784951.585341:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784951.585343:0:23408:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787784951.585346:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787784951.585355:0:23408:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff895201b8b370) 00000020:00000080:1.0:1787784951.585366:0:23408:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1787784951.585370:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787784951.585372:0:23408:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787784951.585376:0:23408:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787784951.585383:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787784951.585438:0:23408:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951f81b5800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787784951.585451:0:23408:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff895201b8cd28) 00000020:00000080:1.0:1787784951.585460:0:23408:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1787784951.585534:0:23408:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787784951.585540:0:23408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x88ace7295d9e867 00000020:00000080:1.0:1787784951.585635:0:23408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787784951.585642:0:23408:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787784951.585645:0:23408:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x88ace7295d9e86e 00080000:01000000:1.0:1787784951.585651:0:23408:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787784951.585654:0:23408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x88ace7295d9e875 00010000:00010000:3.0:1787784951.716240:0:23408:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1787784951.717200:0:23408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1787784951.718051:0:23408:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787784951.720431:0:23408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1787784951.720448:0:23408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784951.720455:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784951.720457:0:23408:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787784951.720460:0:23408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784951.720467:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784951.720469:0:23408:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787784951.720472:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787784951.720478:0:23408:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:00000080:3.0:1787784951.720509:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787784951.720588:0:23408:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8951fb38cd28) 00000020:00000080:3.0:1787784951.720623:0:23408:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1787784951.720631:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787784951.721152:0:23408:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787784951.721162:0:23408:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787784951.721169:0:23408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x88ace7295d9e883 00010000:00080000:3.0:1787784951.721204:0:23408:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8951cfe90000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.141@tcp at head 00010000:00010000:3.0:1787784951.729660:0:23408:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1787784951.732080:0:23408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787784951.732097:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787784951.732139:0:23408:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787784951.732164:0:23408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x88ace7295d9e88a 00000100:00080000:2.0:1787784951.732176:0:23408:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787784951.732190:0:23408:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8951cfe90000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784951.732229:0:23408:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fbe58000 x1874627750245504/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787784951.732263:0:23408:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1787784951.732691:0:23408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784951.732696:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784951.732699:0:23408:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1787784951.732702:0:23408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787784951.732705:0:23408:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787784951.732707:0:23408:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787784951.732709:0:23408:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787784951.732711:0:23408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787784951.732713:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784951.732715:0:23408:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787784951.732717:0:23408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784951.732723:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784951.732724:0:23408:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1787784951.732728:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787784951.732793:0:23408:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787784951.732820:0:23408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784951.732823:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784951.732825:0:23408:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1787784951.732828:0:23408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787784951.732829:0:23408:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1787784951.732831:0:23408:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787784951.732832:0:23408:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787784951.732843:0:23408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787784951.732846:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784951.732848:0:23408:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787784951.732851:0:23408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787784951.732854:0:23408:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787784951.732857:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784951.732878:0:23408:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787784951.732883:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787784951.732887:0:23408:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:2.0:1787784951.732915:0:23408:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787784951.732918:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787784951.732931:0:23408:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8951f02db370) 00000020:00000080:2.0:1787784951.732945:0:23408:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787784951.732950:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787784951.733015:0:23408:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1787784951.733022:0:23408:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787784951.733028:0:23408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x88ace7295d9e898 00000100:00100000:3.0:1787784951.733184:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750245504:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787784951.733266:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784951.733977:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750245504 00000100:00100000:2.0:1787784951.733986:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750245504 00000100:00100000:2.0:1787784951.734021:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784951.734041:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874627750245504:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787784951.734078:0:22675:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:2.0:1787784951.734110:0:22675:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x88ace7295d9e89f 00000004:00100000:2.0:1787784951.734125:0:22675:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787784951.734132:0:22675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:2.0:1787784951.734210:0:23408:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8951fa9c5800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.141@tcp at head 00000100:00080000:0.0:1787784951.734432:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787784951.734437:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787784951.734441:0:37:0:(import.c:65:import_set_state_nolock()) ffff8950c41fe000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784951.734446:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 687 00000100:00080000:0.0:1787784951.734451:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787784951.734455:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8950c41fe000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784951.734483:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fb2570c0 x1874627750245632/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784951.734503:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784951.734507:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787784951.734526:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784951.734530:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787784951.734572:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb254b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750245760:0@lo:400:kworker.0 00000100:00100000:0.0:1787784951.734633:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784951.734684:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750245760 00000100:00100000:0.0:1787784951.734688:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750245760 00000100:00100000:0.0:1787784951.734737:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784951.734746:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb257c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750245760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784951.734824:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb257c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750245760:12345-0@lo:400:kworker.0 Request processed in 80us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784951.734831:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787784951.734889:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8951fb254b40 x1874627750245760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784951.734903:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb254b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750245760:0@lo:400:kworker.0 00000100:00100000:0.0:1787784951.734925:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb2570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750245632:0@lo:38:kworker.0 00000100:00100000:0.0:1787784951.734948:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784951.734980:0:22674:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1787784951.734988:0:22674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1787784951.735121:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750245632 00000100:00100000:0.0:1787784951.735125:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750245632 00000100:00100000:0.0:1787784951.735218:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784951.735223:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb254b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1874627750245632:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787784951.735269:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb254b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1874627750245632:12345-0@lo:38:kworker.0 Request processed in 43us (319us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787784951.735275:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784951.735302:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787784951.735320:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c41fe000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787784951.735324:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787784951.735327:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb2570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750245632:0@lo:38:kworker.0 00010000:00010000:3.0:1787784951.743577:0:23408:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:2.0:1787784951.748248:0:22675:0:(import.c:65:import_set_state_nolock()) ffff8951fa9c4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787784951.748469:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1874627750245504:12345-0@lo:38:llog_process_th.0 Request processed in 14427us (15199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784951.748481:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:01000000:3.0:1787784951.748669:0:23408:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787784951.748786:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787784951.748797:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1787784951.748805:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787784951.748810:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787784951.748813:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951cfe90000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787784951.748982:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750245504:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787784951.749216:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750245888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784951.749265:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784951.749427:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750245888 00000100:00100000:1.0:1787784951.749434:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750245888 00000100:00100000:1.0:1787784951.749508:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784951.749518:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1874627750245888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787784951.749559:0:22674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000040:01000000:3.0:1787784951.749584:0:23408:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1787784951.749611:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1874627750245888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784951.749619:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784951.749923:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750245888:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1787784951.753257:0:23408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784951.753501:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1787784951.753672:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787784951.754542:0:23414:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787784951.754547:0:23414:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787784951.756657:0:23408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787784951.756674:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787784951.757310:0:23408:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787784951.757333:0:23408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x88ace7295d9e8a6 00000100:00080000:3.0:1787784951.757345:0:23408:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787784951.757351:0:23408:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8951fa9c5800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1787784951.757390:0:23408:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fd7c0f00 x1874627750246016/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787784951.757449:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750246016:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787784951.757506:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627750246016 offset 0 length 520: 4 00000100:00080000:3.0:1787784951.757579:0:23408:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787784951.757723:0:23408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784951.757728:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784951.757730:0:23408:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787784951.757733:0:23408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787784951.757736:0:23408:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1787784951.757737:0:23408:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787784951.757739:0:23408:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787784951.757740:0:23408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787784951.757742:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784951.757743:0:23408:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787784951.757746:0:23408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787784951.757749:0:23408:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787784951.757752:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784951.757759:0:23408:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787784951.757763:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787784951.757786:0:23408:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:3.0:1787784951.758233:0:23408:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787784951.758237:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787784951.758252:0:23408:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8951fb3899b8) 00000020:00000080:3.0:1787784951.758268:0:23408:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1787784951.758274:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787784951.758357:0:23408:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1787784951.758364:0:23408:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787784951.758372:0:23408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x88ace7295d9e8b4 00010000:00080000:3.0:1787784951.758403:0:23408:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8950c259a000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.141@tcp at head 00010000:00010000:3.0:1787784951.758623:0:23408:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1787784951.758712:0:23408:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787784951.758730:0:23408:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1787784951.759346:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787784951.759351:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787784951.759355:0:37:0:(import.c:65:import_set_state_nolock()) ffff8950c41fe000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784951.759362:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8950c41fe000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784951.759382:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fb255680 x1874627750246272/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784951.759394:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784951.759398:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787784951.759401:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784951.759403:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787784951.759450:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb2543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750246528:0@lo:400:kworker.0 00000100:00100000:0.0:1787784951.759508:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784951.759561:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750246528 00000100:00100000:0.0:1787784951.759568:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750246528 00000100:00100000:0.0:1787784951.759609:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787784951.759617:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb255a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1874627750246528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784951.759667:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb255a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1874627750246528:12345-0@lo:400:kworker.0 Request processed in 51us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784951.759674:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787784951.759914:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb2543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750246528:0@lo:400:kworker.0 00000100:00100000:2.0:1787784951.760019:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb2570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e11354d-250d-4393-8e0e-7593eb008ce7:3646:1874627750246144:0@lo:400:kworker.0 00000100:00100000:2.0:1787784951.760057:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784951.760099:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784951.760105:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750246400:0@lo:400:kworker.0 00000100:00100000:2.0:1787784951.760134:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784951.760461:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750246144 00000100:00100000:0.0:1787784951.760465:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750246144 00000100:00100000:0.0:1787784951.760501:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787784951.760508:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+15:3646:x1874627750246144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784951.760561:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+15:3646:x1874627750246144:12345-0@lo:400:kworker.0 Request processed in 53us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784951.760567:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787784951.760669:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb2570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e11354d-250d-4393-8e0e-7593eb008ce7:3646:1874627750246144:0@lo:400:kworker.0 00000040:00080000:3.0:1787784951.762929:0:23408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784951.763231:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1787784951.763349:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1787784951.763934:0:23416:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787784951.763939:0:23416:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1787784951.764050:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750246400 00000100:00100000:0.0:1787784951.764060:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750246400 00000100:00100000:0.0:1787784951.764305:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787784951.764316:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbe58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750246400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784951.764424:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbe58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750246400:12345-0@lo:400:kworker.0 Request processed in 110us (4288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784951.764432:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787784951.764510:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8951fb254000 x1874627750246400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784951.764535:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750246400:0@lo:400:kworker.0 00000100:00100000:1.0:1787784951.764650:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb255680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750246272:0@lo:38:kworker.0 00000100:00100000:1.0:1787784951.764691:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784951.764799:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750246272 00000100:00100000:3.0:1787784951.764803:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750246272 00000100:00100000:3.0:1787784951.764837:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787784951.764842:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874627750246272:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787784951.764900:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1874627750246272:12345-0@lo:38:kworker.0 Request processed in 56us (209us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787784951.764906:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1787784951.765004:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c41fe000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784951.765010:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787784951.765013:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb255680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750246272:0@lo:38:kworker.0 00000020:00000080:2.0:1787784951.766028:0:23408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787784951.766044:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787784951.766413:0:23408:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787784951.766436:0:23408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x88ace7295d9e8bb 00000100:00080000:2.0:1787784951.766446:0:23408:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787784951.766452:0:23408:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8950c259a000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784951.766483:0:23408:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fbe59680 x1874627750246656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787784951.766511:0:23408:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1787784951.766602:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750246656:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787784951.766661:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627750246656 offset 0 length 520: 4 00000020:01000000:2.0:1787784951.766958:0:23408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784951.766962:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784951.766964:0:23408:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787784951.766967:0:23408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784951.766971:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784951.766972:0:23408:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787784951.766975:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787784951.766977:0:23408:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787784951.766979:0:23408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784951.766981:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784951.766982:0:23408:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787784951.766984:0:23408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784951.766985:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784951.766986:0:23408:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787784951.766989:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787784951.767020:0:23408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784951.767023:0:23408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784951.767025:0:23408:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787784951.767028:0:23408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:1.0:1787784951.767171:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784951.767176:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784951.767179:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784951.767183:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1787784951.767314:0:23403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1787784951.767349:0:23403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787784951.767369:0:23403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df602200/0x88ace7295d9e83d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e844 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784951.767380:0:23403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951df602200/0x88ace7295d9e83d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e844 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784951.767389:0:23403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8951f81b5800 from 1 10000000:01000000:3.0:1787784951.767392:0:23403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787784951.767418:0:23403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e8c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784951.767426:0:23403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e8c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784951.767438:0:23403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e8c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784951.767454:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750246784:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787784951.767495:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784951.767533:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24da180 going to sleep for 11 seconds 00000100:00100000:0.0:1787784951.767696:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750246784 00000100:00100000:0.0:1787784951.767999:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750246784 00000100:00100000:0.0:1787784951.768047:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787784951.768058:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+15:23403:x1874627750246784:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784951.768080:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784951.768093:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d34600/0x88ace7295d9e8c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e8c2 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784951.768116:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d34600/0x88ace7295d9e8c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e8c2 expref: 16 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784951.768127:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d34600/0x88ace7295d9e8c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e8c2 expref: 16 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784951.768143:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d34600, rc 0) 00000100:00100000:0.0:1787784951.768200:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+16:23403:x1874627750246784:12345-0@lo:101:mount.lustre.0 Request processed in 144us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784951.768207:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787784951.768377:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750246784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784951.768392:0:23403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e8c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e8c9 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784951.768411:0:23403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e8c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e8c9 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784951.769210:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe5b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750246912:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787784951.769259:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784951.769330:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e6480 going to sleep for 11 seconds 00000100:00100000:1.0:1787784951.774027:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750246912 00000100:00100000:1.0:1787784951.774042:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750246912 00000100:00100000:1.0:1787784951.775202:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787784951.775218:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+16:23403:x1874627750246912:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787784951.775255:0:22664:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787784951.775280:0:22664:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787784951.775283:0:22664:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1787784951.775413:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+16:23403:x1874627750246912:12345-0@lo:256:mount.lustre.0 Request processed in 201us (6153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784951.775422:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787784951.776028:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe5b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750246912:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787784951.776672:0:23403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787784951.776705:0:23403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e8c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e8c9 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784951.776718:0:23403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e8c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e8c9 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784951.776739:0:23403:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951f81b5800 from 1 10000000:01000000:3.0:1787784951.776742:0:23403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787784951.776816:0:23403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9e8d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784951.776824:0:23403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9e8d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784951.776834:0:23403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9e8d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784951.777179:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750247040:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787784951.777243:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784951.777615:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24da180 going to sleep for 11 seconds 00000100:00100000:0.0:1787784951.777958:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750247040 00000100:00100000:0.0:1787784951.777966:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750247040 00000100:00100000:0.0:1787784951.778008:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787784951.778018:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+16:23403:x1874627750247040:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784951.778031:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784951.778047:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d34800/0x88ace7295d9e8d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e8d0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784951.778143:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d34800/0x88ace7295d9e8d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e8d0 expref: 17 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784951.778156:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d34800/0x88ace7295d9e8d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e8d0 expref: 17 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784951.778166:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d34800, rc 0) 00000100:00100000:0.0:1787784951.778308:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+17:23403:x1874627750247040:12345-0@lo:101:mount.lustre.0 Request processed in 291us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784951.778315:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787784951.778467:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750247040:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784951.778481:0:23403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9e8d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e8d7 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784951.778490:0:23403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9e8d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e8d7 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787784951.781466:0:23403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1787784951.782200:0:23403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784951.782504:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1787784951.784662:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1787784951.785175:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1787784951.785319:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1787784951.785339:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1787784951.785353:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1787784951.785366:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1787784951.785378:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1787784951.785391:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1787784951.785405:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1787784951.785418:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1787784951.785443:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1787784951.785448:0:23403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1787784951.785630:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe5b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750247168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784951.785697:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784951.786136:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784951.786390:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750247168 00000100:00100000:0.0:1787784951.786398:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750247168 00000100:00100000:0.0:1787784951.786491:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787784951.786502:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+17:23403:x1874627750247168:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784951.786671:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+17:23403:x1874627750247168:12345-0@lo:501:mount.lustre.0 Request processed in 170us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784951.786691:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787784951.786870:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe5b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750247168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784951.786905:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe5b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750247296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787784951.786948:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784951.787931:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784951.788109:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750247296 00000100:00100000:1.0:1787784951.788118:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750247296 00000100:00100000:1.0:1787784951.788161:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787784951.788170:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+17:23403:x1874627750247296:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784951.788317:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+17:23403:x1874627750247296:12345-0@lo:503:mount.lustre.0 Request processed in 148us (1368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784951.788326:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787784951.788510:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe5b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750247296:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787784951.789382:0:23403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787784951.789461:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe5b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750247424:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784951.789581:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784951.789610:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784951.789682:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750247424 00000100:00100000:1.0:1787784951.789687:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750247424 00000100:00100000:1.0:1787784951.789723:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787784951.789732:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+17:23403:x1874627750247424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784951.789941:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+17:23403:x1874627750247424:12345-0@lo:502:mount.lustre.0 Request processed in 209us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784951.789949:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787784951.790051:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe5b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750247424:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787784951.790400:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1787784951.790428:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1787784951.790443:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1787784951.790456:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1787784951.790485:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1787784951.790501:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1787784951.790588:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1787784951.790607:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1787784951.790619:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1787784951.790630:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1787784951.790643:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1787784951.790666:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe5b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750247552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784951.790709:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784951.790734:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784951.791409:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750247552 00000100:00100000:1.0:1787784951.791415:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750247552 00000100:00100000:1.0:1787784951.791448:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787784951.791464:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+17:23403:x1874627750247552:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784951.791633:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+17:23403:x1874627750247552:12345-0@lo:502:mount.lustre.0 Request processed in 171us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784951.791641:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787784951.791723:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe5b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750247552:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787784951.792276:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1787784951.792290:0:23403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1787784951.797603:0:23418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784951.797619:0:23418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784951.797621:0:23418:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787784951.797628:0:23418:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8951f81b5800 00000020:00000080:2.0:1787784951.797639:0:23418:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787784951.797647:0:23418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784951.797649:0:23418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784951.797650:0:23418:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787784951.797652:0:23418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784951.797655:0:23418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784951.797657:0:23418:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787784951.797660:0:23418:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8951f81b5800 00000020:00000080:2.0:1787784951.797662:0:23418:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787784951.797728:0:23418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784951.797732:0:23418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784951.797733:0:23418:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787784951.797736:0:23418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784951.797738:0:23418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784951.797740:0:23418:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787784951.797743:0:23418:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8951f81b5800 00000020:00000080:2.0:1787784951.797745:0:23418:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787784951.797763:0:23418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784951.797799:0:23418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784951.797811:0:23418:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787784951.797814:0:23418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784951.797819:0:23418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784951.797823:0:23418:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787784951.797827:0:23418:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8951f81b5800 00000020:00000080:2.0:1787784951.797832:0:23418:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787784951.797869:0:23418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784951.797873:0:23418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784951.797874:0:23418:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787784951.797878:0:23418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1787784951.797939:0:23403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787784951.798170:0:23403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787784951.798200:0:23403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9e8d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e8d7 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784951.798241:0:23403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9e8d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e8d7 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784951.798293:0:23403:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787784951.798297:0:23403:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8951f81b5800 10000000:01000000:2.0:1787784951.798300:0:23403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8951f81b5800 10000000:01000000:2.0:1787784951.798305:0:23403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787784951.798312:0:23403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8951f81b5800 from 1 10000000:01000000:2.0:1787784951.798315:0:23403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787784951.798356:0:23403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1629200/0x88ace7295d9e8de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784951.798371:0:23403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1629200/0x88ace7295d9e8de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784951.798387:0:23403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1629200/0x88ace7295d9e8de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784951.798426:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe5b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750247680:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787784951.798542:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784951.798661:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e6240 going to sleep for 11 seconds 00000100:00100000:1.0:1787784951.799530:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750247680 00000100:00100000:1.0:1787784951.799540:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750247680 00000100:00100000:1.0:1787784951.799585:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787784951.799594:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+17:23403:x1874627750247680:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784951.799620:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784951.799644:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df603600/0x88ace7295d9e8e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e8de expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.799687:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df603600/0x88ace7295d9e8e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e8de expref: 18 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.799702:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df603600/0x88ace7295d9e8e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e8de expref: 18 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.799712:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603600, rc 0) 00000100:00100000:1.0:1787784951.799925:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+18:23403:x1874627750247680:12345-0@lo:101:mount.lustre.0 Request processed in 208us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784951.799939:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787784951.800821:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe5b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750247680:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784951.800850:0:23403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1629200/0x88ace7295d9e8de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e8e5 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784951.800877:0:23403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1629200/0x88ace7295d9e8de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e8e5 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787784951.804448:0:23403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1787784951.805672:0:23403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784951.806360:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1787784951.806388:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1787784951.806402:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1787784951.806416:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1787784951.806428:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1787784951.806440:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1787784951.806453:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1787784951.806466:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1787784951.806480:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1787784951.806493:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1787784951.806533:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1787784951.806549:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1787784951.806560:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1787784951.806571:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1787784951.806581:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1787784951.806593:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1787784951.806605:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1787784951.806615:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1787784951.806626:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1787784951.806637:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1787784951.806647:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1787784951.806657:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1787784951.806666:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1787784951.806677:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1787784951.806687:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1787784951.806696:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1787784951.806722:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1787784951.806738:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1787784951.806750:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1787784951.806874:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1787784951.806896:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1787784951.806908:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1787784951.806918:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1787784951.806928:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1787784951.806938:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1787784951.806949:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1787784951.806960:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1787784951.806971:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1787784951.806982:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1787784951.806993:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1787784951.807004:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1787784951.807015:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1787784951.807039:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1787784951.807052:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1787784951.807063:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1787784951.807145:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1787784951.807157:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1787784951.807169:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1787784951.807283:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1787784951.807304:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1787784951.807321:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1787784951.807327:0:23403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1787784951.807425:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe5b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750247808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784951.807495:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784951.807533:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e6480 going to sleep for 11 seconds 00000100:00100000:1.0:1787784951.807660:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750247808 00000100:00100000:1.0:1787784951.807666:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750247808 00000100:00100000:1.0:1787784951.807715:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787784951.807724:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+18:23403:x1874627750247808:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784951.807885:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+18:23403:x1874627750247808:12345-0@lo:501:mount.lustre.0 Request processed in 161us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784951.807905:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787784951.808192:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe5b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750247808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784951.808235:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750247936:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787784951.808278:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784951.808309:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24da180 going to sleep for 11 seconds 00000100:00100000:1.0:1787784951.808361:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750247936 00000100:00100000:1.0:1787784951.808366:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750247936 00000100:00100000:1.0:1787784951.808397:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787784951.808404:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+18:23403:x1874627750247936:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784951.808481:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+18:23403:x1874627750247936:12345-0@lo:503:mount.lustre.0 Request processed in 76us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784951.808487:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787784951.808617:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750247936:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787784951.809233:0:23403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787784951.809308:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750248064:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784951.809346:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784951.809472:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8952021c7780 going to sleep for 11 seconds 00000100:00100000:1.0:1787784951.817173:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750248064 00000100:00100000:1.0:1787784951.817192:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750248064 00000100:00100000:1.0:1787784951.817291:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787784951.817301:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+18:23403:x1874627750248064:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784951.817492:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+18:23403:x1874627750248064:12345-0@lo:502:mount.lustre.0 Request processed in 192us (8144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784951.817500:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787784951.817940:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750248064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787784951.819033:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1787784951.820924:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1787784951.820966:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1787784951.820980:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1787784951.820992:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1787784951.821006:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1787784951.821034:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1787784951.821048:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1787784951.821060:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1787784951.821284:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1787784951.821300:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1787784951.821311:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1787784951.821321:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1787784951.821332:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1787784951.821343:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1787784951.821353:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1787784951.821364:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1787784951.821374:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1787784951.821385:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1787784951.821397:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1787784951.821409:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1787784951.821422:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1787784951.821446:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1787784951.821458:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1787784951.821468:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1787784951.821488:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1787784951.821499:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1787784951.821509:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1787784951.822488:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1787784951.822898:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1787784951.822920:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1787784951.822932:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1787784951.822942:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1787784951.822954:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1787784951.822966:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1787784951.822977:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1787784951.822989:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1787784951.823002:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1787784951.823028:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1787784951.823042:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1787784951.823055:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1787784951.824174:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1787784951.824211:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1787784951.824227:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1787784951.824241:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1787784951.824253:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1787784951.824266:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1787784951.824278:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1787784951.824333:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750248192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784951.824416:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784951.824468:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d2557a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784951.825218:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750248192 00000100:00100000:1.0:1787784951.825226:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750248192 00000100:00100000:1.0:1787784951.825279:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787784951.825289:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+18:23403:x1874627750248192:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784951.826763:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+18:23403:x1874627750248192:12345-0@lo:502:mount.lustre.0 Request processed in 1470us (2341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784951.826789:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787784951.826937:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750248192:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787784951.827158:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:1.0:1787784951.827182:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:1.0:1787784951.827218:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750248320:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784951.827256:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784951.827286:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e32840 going to sleep for 11 seconds 00000100:00100000:1.0:1787784951.827301:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750248320 00000100:00100000:1.0:1787784951.827305:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750248320 00000100:00100000:1.0:1787784951.827338:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787784951.827346:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+18:23403:x1874627750248320:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784951.827414:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+18:23403:x1874627750248320:12345-0@lo:502:mount.lustre.0 Request processed in 69us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784951.827421:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787784951.827461:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750248320:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787784951.827494:0:23403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1787784951.827502:0:23403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787784951.828219:0:23422:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1787784951.828241:0:23422:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8951e6523370) 00000020:00000080:1.0:1787784951.828263:0:23422:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1787784951.828344:0:23422:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951f81b5800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787784951.828348:0:23422:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951f81b5800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787784951.828350:0:23422:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951f81b5800 3 00010000:00080000:1.0:1787784951.828386:0:23422:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8951ff5cb800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.141@tcp at head 00010000:00010000:0.0:1787784951.834234:0:23422:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1787784951.834447:0:23422:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1787784951.835701:0:23422:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787784951.835720:0:23422:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x88ace7295d9e8f3 00000100:00080000:0.0:1787784951.835733:0:23422:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787784951.835739:0:23422:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8951ff5cb800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784951.836898:0:23422:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fb2543c0 x1874627750248448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784951.836930:0:23422:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787784951.837356:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784951.837361:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787784951.837363:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784951.837366:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787784951.837395:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb2543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874627750248448:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787784951.841286:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784951.841443:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750248448 00000100:00100000:0.0:1787784951.841451:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750248448 00000100:00100000:0.0:1787784951.841489:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787784951.841497:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb254780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1874627750248448:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787784951.841598:0:22670:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:0.0:1787784951.841646:0:22670:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x88ace7295d9e8fa 00000004:00100000:0.0:1787784951.841661:0:22670:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787784951.841691:0:22670:0:(import.c:65:import_set_state_nolock()) ffff8951d87e8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784951.841751:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb254780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1874627750248448:12345-0@lo:38:llog_process_th.0 Request processed in 253us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784951.841759:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787784951.841903:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8951fb2543c0 x1874627750248448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784951.841915:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787784951.841923:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1787784951.841931:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787784951.841936:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787784951.841938:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951ff5cb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787784951.841945:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb2543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1874627750248448:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787784951.853031:0:23422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:1.0:1787784951.853958:0:23403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787784951.853990:0:23403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787784951.854014:0:23403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1629200/0x88ace7295d9e8de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e8e5 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.854026:0:23403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1629200/0x88ace7295d9e8de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e8e5 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787784951.854912:0:23403:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787784951.854915:0:23403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787784951.854916:0:23403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784951.854917:0:23403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784951.854919:0:23403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784951.854920:0:23403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784951.854921:0:23403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787784951.854923:0:23403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784951.854924:0:23403:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787784951.854929:0:23403:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1787784951.854932:0:23403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787784951.854933:0:23403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787784951.854934:0:23403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784951.854936:0:23403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784951.854937:0:23403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784951.854938:0:23403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784951.854939:0:23403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787784951.854940:0:23403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784951.854941:0:23403:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787784951.854967:0:23403:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787784951.854987:0:23403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750248576:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787784951.855054:0:23403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784951.856188:0:23403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d2148cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784951.856216:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750248576 00000100:00100000:1.0:1787784951.856224:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750248576 00000100:00100000:1.0:1787784951.856270:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787784951.856280:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff08bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+18:23403:x1874627750248576:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787784951.856308:0:22662:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787784951.856324:0:22662:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1787784951.861261:0:22650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1787784951.861294:0:22662:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787784951.861305:0:22662:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1787784951.861365:0:22685:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787784951.861378:0:22685:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787784951.861401:0:22685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8951df603800/0x88ace7295d9e901 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.861419:0:22685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951c0030200/0x88ace7295d9e805 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e7fe expref: 18 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.861426:0:22685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951e1d34600/0x88ace7295d9e8c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e8c2 expref: 18 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.861434:0:22685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8951df603800/0x88ace7295d9e901 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.861474:0:22685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951e1d34600/0x88ace7295d9e8c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9e8c2 expref: 18 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.861489:0:22685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951e1d34600/0x88ace7295d9e8c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9e8c2 expref: 18 pid: 22662 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784951.861503:0:22685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5c780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22685:1874627750248704:0@lo:104: 00000100:00100000:1.0:1787784951.861576:0:22685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787784951.861629:0:22685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951c0030200/0x88ace7295d9e805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9e7fe expref: 18 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.861637:0:22685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951c0030200/0x88ace7295d9e805 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9e7fe expref: 18 pid: 22662 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784951.861644:0:22685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5da40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22685:1874627750248832:0@lo:104: 00000100:00100000:1.0:1787784951.861663:0:22685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784951.861677:0:22685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d21483c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784951.861710:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750248704 00000100:00100000:1.0:1787784951.861722:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750248704 00000100:00100000:1.0:1787784951.861756:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750248832 00000100:00100000:1.0:1787784951.861758:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750248832 00000100:00100000:1.0:1787784951.861800:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784951.863414:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e11354d-250d-4393-8e0e-7593eb008ce7+4:22685:x1874627750248704:12345-0@lo:104: 00010000:00010000:1.0:1787784951.863431:0:22654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e8c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e8c9 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.863505:0:22654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787784951.863523:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e11354d-250d-4393-8e0e-7593eb008ce7+4:22685:x1874627750248704:12345-0@lo:104: Request processed in 110us (1936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784951.863531:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784951.863560:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787784951.863566:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e11354d-250d-4393-8e0e-7593eb008ce7+3:22685:x1874627750248832:12345-0@lo:104: 00010000:00010000:1.0:1787784951.863573:0:22654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951df603c00/0x88ace7295d9e7fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e805 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.863603:0:22654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787784951.863607:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e11354d-250d-4393-8e0e-7593eb008ce7+3:22685:x1874627750248832:12345-0@lo:104: Request processed in 43us (1944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784951.863612:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787784951.863631:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784951.863636:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e8c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e8c9 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.863644:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0031800 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:1.0:1787784951.863648:0:22659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e8c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9e8c9 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.863670:0:22659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e8c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9e8c9 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784951.863676:0:22659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e8c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9e8c9 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784951.863682:0:22659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787784951.863722:0:22659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e8c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e8c9 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.863728:0:22659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784951.863747:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e8c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e8c9 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.863754:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e8c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e8c9 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.863787:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784951.863791:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951df603c00/0x88ace7295d9e7fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e805 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.863797:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603c00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:1.0:1787784951.863799:0:22659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951df603c00/0x88ace7295d9e7fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9e805 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.863816:0:22659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951df603c00/0x88ace7295d9e7fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9e805 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784951.863823:0:22659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951df603c00/0x88ace7295d9e7fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9e805 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784951.863835:0:22659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787784951.863850:0:22659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951df603c00/0x88ace7295d9e7fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e805 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.863855:0:22659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784951.863887:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951df603c00/0x88ace7295d9e7fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e805 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.863894:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951df603c00/0x88ace7295d9e7fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e805 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.863907:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784951.863909:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784951.863911:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784951.863916:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784951.863928:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e11354d-250d-4393-8e0e-7593eb008ce7:3645:1874627750248960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784951.863963:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784951.864008:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e11354d-250d-4393-8e0e-7593eb008ce7:3646:1874627750249088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784951.864024:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784951.864058:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750248960 00000100:00100000:1.0:1787784951.864062:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750248960 00010000:00010000:1.0:1787784951.864183:0:22656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951e1d34600/0x88ace7295d9e8c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e8c2 expref: 19 pid: 22662 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784951.864200:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750249088 00000100:00100000:1.0:1787784951.864202:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750249088 00010000:00010000:1.0:1787784951.864211:0:22656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951c0030200/0x88ace7295d9e805 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e7fe expref: 20 pid: 22662 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784951.864236:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784951.864243:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e11354d-250d-4393-8e0e-7593eb008ce7+20:3645:x1874627750248960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787784951.864253:0:22656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784951.864258:0:22656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951e1d34600/0x88ace7295d9e8c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e8c2 expref: 20 pid: 22662 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.864269:0:22656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951e1d34600/0x88ace7295d9e8c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9e8c2 expref: 20 pid: 22662 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.864284:0:22656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784951.864313:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e11354d-250d-4393-8e0e-7593eb008ce7+20:3645:x1874627750248960:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784951.864320:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784951.864332:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787784951.864338:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e11354d-250d-4393-8e0e-7593eb008ce7+19:3646:x1874627750249088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787784951.864359:0:22656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784951.864364:0:22656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951c0030200/0x88ace7295d9e805 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e7fe expref: 19 pid: 22662 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.864373:0:22656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951c0030200/0x88ace7295d9e805 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9e7fe expref: 19 pid: 22662 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.864385:0:22656:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8951df603800/0x88ace7295d9e901 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.864393:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df603800/0x88ace7295d9e901 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787784951.864418:0:22656:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005650253s 00010000:00010000:1.0:1787784951.864423:0:22656:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951df603800/0x88ace7295d9e901 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.864430:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951df603800/0x88ace7295d9e901 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.864436:0:22656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8951df603800/0x88ace7295d9e901 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.864443:0:22656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8951df603800/0x88ace7295d9e901 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.864449:0:22656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603800 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784951.864451:0:22656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8951df603800/0x88ace7295d9e901 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.864457:0:22656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8951df603800/0x88ace7295d9e901 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.864462:0:22656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8951df603800/0x88ace7295d9e901 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.864468:0:22656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784951.864489:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e11354d-250d-4393-8e0e-7593eb008ce7+19:3646:x1874627750249088:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784951.864494:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787784951.864521:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e11354d-250d-4393-8e0e-7593eb008ce7:3645:1874627750248960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784951.864535:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e11354d-250d-4393-8e0e-7593eb008ce7:3646:1874627750249088:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787784951.864557:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d34600/0x88ace7295d9e8c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9e8c2 expref: 18 pid: 22662 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784951.864565:0:22685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5c780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22685:1874627750248704:0@lo:104: 00010000:00010000:1.0:1787784951.864570:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c0030200/0x88ace7295d9e805 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9e7fe expref: 17 pid: 22662 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784951.864575:0:22685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5da40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22685:1874627750248832:0@lo:104: 00010000:00010000:1.0:1787784951.864583:0:22685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8951df603800/0x88ace7295d9e901 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.864588:0:22685:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8951df603800/0x88ace7295d9e901 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.864592:0:22685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8951df603800/0x88ace7295d9e901 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784951.864596:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df603800/0x88ace7295d9e901 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784951.869800:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff08bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+16:23403:x1874627750248576:12345-0@lo:253:mount.lustre.0 Request processed in 13513us (14737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784951.869821:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787784951.873957:0:23403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:23403:1874627750248576:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787784951.873973:0:23403:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787784951.873976:0:23403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787784951.873977:0:23403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787784951.873978:0:23403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784951.873979:0:23403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784951.873979:0:23403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784951.873980:0:23403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784951.873981:0:23403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787784951.873983:0:23403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784951.873984:0:23403:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787784951.874004:0:23403:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:0.0:1787784951.883935:0:23403:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1787784951.884132:0:23430:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1787784951.884136:0:23430:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787784951.884217:0:23431:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1787784951.884583:0:23431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1787784951.884930:0:23403:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1787784951.886317:0:23432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb2543c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23432:1874627750249216:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787784951.886393:0:23432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784951.886437:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750249216 00000100:00100000:0.0:1787784951.886444:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750249216 00000100:00100000:0.0:1787784951.886488:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787784951.886496:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb2552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23432:x1874627750249216:12345-0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1787784951.886711:0:23403:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1787784951.886753:0:23403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787784951.887676:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb2552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23432:x1874627750249216:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 1177us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784951.887685:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787784951.887718:0:23432:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33556c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784951.887752:0:23432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb2543c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23432:1874627750249216:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1787784951.887797:0:23432:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787784951.888633:0:23432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb2543c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23432:1874627750249344:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787784951.888680:0:23432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784951.888720:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750249344 00000100:00100000:0.0:1787784951.888726:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750249344 00000100:00100000:0.0:1787784951.888760:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787784951.888788:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb257840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23432:x1874627750249344:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787784951.889712:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb257840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23432:x1874627750249344:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 941us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784951.889721:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787784951.889754:0:23432:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33556c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784951.889789:0:23432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb2543c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23432:1874627750249344:0@lo:1000:lod0001_rec0000.0 00000004:00000080:2.0:1787784951.890209:0:23403:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787784951.890255:0:23403:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1787784951.890337:0:23403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787784951.891219:0:23432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb2543c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23432:1874627750249472:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787784951.891265:0:23432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784951.891317:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750249472 00000100:00100000:0.0:1787784951.891323:0:22680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750249472 00000100:00100000:0.0:1787784951.891360:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784951.891367:0:22680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb255680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23432:x1874627750249472:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787784951.891408:0:22680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb255680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23432:x1874627750249472:12345-0@lo:900:lod0001_rec0000.0 Request processed in 41us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784951.891415:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784951.891434:0:23432:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355300 going to sleep for 11 seconds 00010000:00080000:0.0:1787784951.891451:0:23432:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8951fb2543c0 x1874627750249472/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787784967 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784951.891478:0:23432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb2543c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23432:1874627750249472:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787784951.892636:0:23432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb2543c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23432:1874627750249600:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787784951.892681:0:23432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784951.892717:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750249600 00000100:00100000:0.0:1787784951.892722:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750249600 00000100:00100000:0.0:1787784951.892759:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787784951.892782:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23432:x1874627750249600:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1787784951.893180:0:23431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787784951.893236:0:23431:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1787784951.893696:0:23432:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33556c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784951.893833:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23432:x1874627750249600:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 1065us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784951.893842:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000040:00080000:2.0:1787784951.894311:0:23403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1787784951.894793:0:23432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb2543c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23432:1874627750249600:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1787784951.894995:0:23432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784951.896494:0:23403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787784951.897664:0:23403:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1787784951.898254:0:23403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787784951.900122:0:23432:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787784951.900198:0:23432:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787784951.900203:0:23432:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00080000:10000000:3.0:1787784951.902698:0:23403:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:3.0:1787784951.905460:0:23403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1787784951.915672:0:23403:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787784951.915715:0:23403:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb77a0147b988 00100000:10000000:3.0:1787784951.915724:0:23403:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1787784951.916610:0:23403:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787784951.916643:0:23403:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.141@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787784951.916659:0:23403:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787784951.916682:0:23403:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1787784951.919471:0:23403:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787784951.919701:0:23403:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787784951.942203:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81decc0 going to sleep for 0 seconds 00010000:00010000:1.0:1787784952.518146:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787784952.905282:0:23428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787784952.965970:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81decc0 going to sleep for 0 seconds 10000000:01000000:3.0:1787784953.349994:0:22668:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787784953.350004:0:22668:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8951f81b5800 from 12 10000000:01000000:3.0:1787784953.350012:0:22668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787784953.350067:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0030200/0x88ace7295d9e908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784953.350080:0:22668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951c0030200/0x88ace7295d9e908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784953.350093:0:22668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951c0030200/0x88ace7295d9e908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784953.350121:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750249728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784953.350194:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784953.350288:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24e8840 going to sleep for 11 seconds 00000100:00100000:2.0:1787784953.352983:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750249728 00000100:00100000:2.0:1787784953.352997:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750249728 00000100:00100000:2.0:1787784953.353150:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787784953.353161:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff08a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+16:22668:x1874627750249728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784953.353179:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784953.353209:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1628c00/0x88ace7295d9e90f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e908 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784953.353238:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1628c00/0x88ace7295d9e90f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e908 expref: 17 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784953.353249:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1628c00/0x88ace7295d9e90f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e908 expref: 17 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784953.353259:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628c00, rc 0) 00000100:00100000:2.0:1787784953.353342:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff08a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+17:22668:x1874627750249728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (3149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784953.353349:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787784953.353360:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750249728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784953.353380:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951c0030200/0x88ace7295d9e908 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e90f expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784953.353389:0:22668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951c0030200/0x88ace7295d9e908 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e90f expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784953.353462:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750249856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787784953.353516:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784953.353549:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24e8840 going to sleep for 11 seconds 00000100:00100000:2.0:1787784953.353559:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750249856 00000100:00100000:2.0:1787784953.353563:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750249856 00000100:00100000:2.0:1787784953.353593:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787784953.353600:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff08b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+17:22668:x1874627750249856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787784953.353614:0:22662:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787784953.353630:0:22662:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787784953.353638:0:22662:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1787784953.353822:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff08b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+17:22668:x1874627750249856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 221us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784953.353826:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750249856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787784953.353829:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 10000000:01000000:3.0:1787784953.353876:0:22668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787784953.353883:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0030200/0x88ace7295d9e908 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e90f expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784953.353891:0:22668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951c0030200/0x88ace7295d9e908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e90f expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784953.353898:0:22668:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787784953.353900:0:22668:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8951ff20c000 from 12 10000000:01000000:3.0:1787784953.353902:0:22668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787784953.353918:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e916 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784953.353923:0:22668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e916 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784953.353928:0:22668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e916 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784953.353936:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750249984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784953.353954:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784953.353974:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24e8840 going to sleep for 11 seconds 00000100:00100000:2.0:1787784953.353990:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750249984 00000100:00100000:2.0:1787784953.353994:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750249984 00000100:00100000:2.0:1787784953.354090:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787784953.354098:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+17:22668:x1874627750249984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784953.354106:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784953.354115:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1629e00/0x88ace7295d9e91d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e916 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784953.354131:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1629e00/0x88ace7295d9e91d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e916 expref: 18 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784953.354139:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1629e00/0x88ace7295d9e91d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e916 expref: 18 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784953.354146:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629e00, rc 0) 00000100:00100000:2.0:1787784953.354182:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+18:22668:x1874627750249984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784953.354187:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787784953.354315:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750249984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784953.354326:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e916 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e91d expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784953.354333:0:22668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e916 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e91d expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784953.354548:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb256d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750250112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787784953.354577:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784953.357067:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33b5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787784953.357108:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750250112 00000100:00100000:0.0:1787784953.357117:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750250112 00000100:00100000:0.0:1787784953.357164:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787784953.357174:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+18:22668:x1874627750250112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787784953.357218:0:22662:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787784953.357236:0:22662:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787784953.357239:0:22662:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1787784953.357352:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+18:22668:x1874627750250112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 179us (2772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784953.357360:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787784953.357406:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb256d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750250112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787784953.357470:0:22668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787784953.357479:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e916 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e91d expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784953.357488:0:22668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e91d expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784953.541949:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787784953.928453:0:23428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787784953.993074:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81decc0 going to sleep for 0 seconds 00010000:00010000:1.0:1787784954.565865:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784955.013916:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81decc0 going to sleep for 0 seconds 00010000:00010000:1.0:1787784955.590918:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784956.037924:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81decc0 going to sleep for 0 seconds 00000001:02000400:0.0:1787784956.296436:0:23674:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787784956.624654:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787784957.062606:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787784957.062613:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787784957.062616:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8950c41fe000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787784957.062627:0:15021:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8950c41fe000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784957.062647:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fbe5bc00 x1874627750250368/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787784957.062676:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784957.062680:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784957.062683:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784957.062686:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784957.062707:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784957.062710:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784957.062713:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784957.062716:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787784957.062741:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750250752:0@lo:400:kworker.0 00000100:00100000:2.0:1787784957.062836:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784957.062887:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784957.062892:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e11354d-250d-4393-8e0e-7593eb008ce7:3646:1874627750250240:0@lo:400:kworker.0 00000100:00100000:2.0:1787784957.062917:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784957.062941:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750250496:0@lo:400:kworker.0 00000100:00100000:2.0:1787784957.062961:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784957.062975:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784957.062979:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe5a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750250624:0@lo:400:kworker.0 00000100:00100000:2.0:1787784957.062999:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784957.063025:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750250240 00000100:00100000:2.0:1787784957.063030:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750250240 00000100:00100000:2.0:1787784957.063066:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787784957.063073:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff08a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+18:3646:x1874627750250240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784957.063122:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff08a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+18:3646:x1874627750250240:12345-0@lo:400:kworker.0 Request processed in 49us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784957.063129:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787784957.063161:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750250368:0@lo:38:kworker.0 00000100:00100000:2.0:1787784957.063179:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784957.063212:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e11354d-250d-4393-8e0e-7593eb008ce7:3646:1874627750250240:0@lo:400:kworker.0 00000100:00100000:3.0:1787784957.066700:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81decc0 going to sleep for 0 seconds 00000100:00100000:3.0:1787784957.066932:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750250880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787784957.066999:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784957.067305:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750250624 00000100:00100000:2.0:1787784957.067313:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750250624 00000100:00100000:2.0:1787784957.067350:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750250368 00000100:00100000:2.0:1787784957.067353:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750250368 00000100:00100000:2.0:1787784957.067360:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750250880 00000100:00100000:2.0:1787784957.067362:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750250880 00000100:00100000:2.0:1787784957.067376:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784957.067384:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbe583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1874627750250624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784957.067450:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbe583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1874627750250624:12345-0@lo:400:kworker.0 Request processed in 67us (4450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784957.067458:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784957.067550:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787784957.067554:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbe5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1874627750250368:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787784957.067579:0:22675:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 697 last 0 00000020:00000080:2.0:1787784957.067613:0:22675:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88ace7295d9e924 00000004:00100000:2.0:1787784957.067629:0:22675:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787784957.067635:0:22675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1787784957.067761:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe5a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750250624:0@lo:400:kworker.0 00000100:00100000:0.0:1787784957.069744:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750250752 00000100:00100000:0.0:1787784957.069757:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750250752 00000100:00100000:0.0:1787784957.069841:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750250496 00000100:00100000:0.0:1787784957.069844:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750250496 00000100:00100000:0.0:1787784957.069860:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787784957.069868:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbe58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750250752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784957.069947:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbe58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750250752:12345-0@lo:400:kworker.0 Request processed in 80us (7111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784957.069954:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787784957.069968:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784957.069973:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbe5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750250496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784957.070029:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbe5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750250496:12345-0@lo:400:kworker.0 Request processed in 55us (7066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784957.070035:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784957.070060:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787784957.070068:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750250880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787784957.070095:0:23412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787784957.070139:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750250880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (3141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784957.070145:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787784957.070200:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750250880:0@lo:41:osp-pre-0-1.0 00010000:00080000:0.0:1787784957.070236:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951fbe59a40 x1874627750250496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784957.070248:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750250496:0@lo:400:kworker.0 00010000:00080000:1.0:1787784957.070925:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951fbe59e00 x1874627750250752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784957.070938:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750250752:0@lo:400:kworker.0 00000100:00080000:2.0:1787784957.083075:0:22675:0:(import.c:65:import_set_state_nolock()) ffff8951fa9c5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787784957.083180:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbe5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1874627750250368:12345-0@lo:38:kworker.0 Request processed in 15622us (19998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784957.087765:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787784957.087877:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787784957.087890:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787784957.087897:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787784957.087902:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c41fe000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787784957.087921:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000056e8df75): req@ffff8951fb254f00 x1874627750242944/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784957.087943:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750250368:0@lo:38:kworker.0 00000100:00100000:2.0:1787784957.088096:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784957.088120:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d81decc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784957.088135:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750251008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784957.088154:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784957.088184:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750242944 00000100:00100000:2.0:1787784957.088189:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750242944 00000100:00100000:2.0:1787784957.088226:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750251008 00000100:00100000:2.0:1787784957.088229:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750251008 00000100:00100000:2.0:1787784957.088243:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787784957.088251:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbe5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22711:x1874627750242944:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787784957.088332:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbe5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22711:x1874627750242944:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 80us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784957.088339:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787784957.088351:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787784957.088358:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbe5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750251008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787784957.088379:0:23412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787784957.088417:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbe5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750251008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784957.088436:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787784957.088688:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb254f00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22711:1874627750242944:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1787784957.088724:0:22711:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787784957.088757:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe59e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22711:1874627750251136:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787784957.088807:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784957.088840:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355600 going to sleep for 11 seconds 00000100:00100000:2.0:1787784957.088863:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750251008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784957.088876:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750251136 00000100:00100000:2.0:1787784957.088879:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750251136 00000100:00100000:2.0:1787784957.088897:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787784957.088902:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbe59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22711:x1874627750251136:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787784957.088984:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbe59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22711:x1874627750251136:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 81us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784957.088991:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787784957.089016:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe59e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22711:1874627750251136:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787784957.089078:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe59e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22711:1874627750251264:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787784957.089097:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784957.089109:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3355600 going to sleep for 11 seconds 00000100:00100000:2.0:1787784957.089118:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750251264 00000100:00100000:2.0:1787784957.089121:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750251264 00000100:00100000:2.0:1787784957.089138:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787784957.089143:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbe5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22711:x1874627750251264:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787784957.089179:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbe5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22711:x1874627750251264:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 36us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784957.093089:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787784957.093188:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe59e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22711:1874627750251264:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1787784957.093571:0:22711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784957.098976:0:22711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787784957.099065:0:22711:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:2.0:1787784957.099070:0:22711:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:2.0:1787784957.366567:0:23726:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787784957.366762:0:23726:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787784957.644691:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787784958.091220:0:22705:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1787784958.276505:0:23776:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787784958.276703:0:23776:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787784958.663626:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787784959.223732:0:23825:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea2f93600 20000000:00000080:2.0:1787784959.223748:0:23825:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8951e657f400 uarg=0000000000000000 20000000:01000000:2.0:1787784959.223871:0:23825:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787784959.223878:0:23825:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787784959.223882:0:23825:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787784959.224309:0:23826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1787784959.224514:0:23825:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787784959.229988:0:23825:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787784959.230015:0:23825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8951c151e400/0x88ace7295d9e92b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784959.230031:0:23825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951d1629c00/0x88ace7295d9e7d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e7cd expref: 17 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784959.230036:0:23825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951e1d34800/0x88ace7295d9e8d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e8d0 expref: 17 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784959.230041:0:23825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8951c151e400/0x88ace7295d9e92b lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784959.230077:0:23825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951e1d34800/0x88ace7295d9e8d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9e8d0 expref: 17 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784959.230089:0:23825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951e1d34800/0x88ace7295d9e8d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9e8d0 expref: 17 pid: 22662 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784959.230099:0:23825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c3c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23825:1874627750251392:0@lo:104: 00000100:00100000:3.0:1787784959.230158:0:23825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787784959.230332:0:23825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951d1629c00/0x88ace7295d9e7d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9e7cd expref: 17 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784959.230337:0:23825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951d1629c00/0x88ace7295d9e7d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9e7cd expref: 17 pid: 22664 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784959.230343:0:23825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c1e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23825:1874627750251520:0@lo:104: 00000100:00100000:3.0:1787784959.230360:0:23825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784959.230433:0:23825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24e83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784959.230543:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750251392 00000100:00100000:2.0:1787784959.230550:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750251392 00000100:00100000:2.0:1787784959.230581:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750251520 00000100:00100000:2.0:1787784959.230582:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750251520 00000100:00100000:2.0:1787784959.230590:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784959.230597:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+4:23825:x1874627750251392:12345-0@lo:104: 00010000:00010000:2.0:1787784959.230606:0:22653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9e8d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e8d7 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784959.230653:0:22653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787784959.230659:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+4:23825:x1874627750251392:12345-0@lo:104: Request processed in 62us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784959.230674:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787784959.230680:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784959.230686:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9e8d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e8d7 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784959.230694:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0030400 already unused, calling callback (ffffffffc1382c20) 00000100:00100000:2.0:1787784959.230696:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 10000000:00010000:0.0:1787784959.230698:0:22658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9e8d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9e8d7 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784959.230702:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+3:23825:x1874627750251520:12345-0@lo:104: 00010000:00010000:0.0:1787784959.230706:0:22658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9e8d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9e8d7 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784959.230709:0:22653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9e7cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e7d4 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784959.230714:0:22658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9e8d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9e8d7 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784959.230726:0:22658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787784959.230740:0:22653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787784959.230745:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+3:23825:x1874627750251520:12345-0@lo:104: Request processed in 44us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784959.230751:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787784959.230758:0:22658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9e8d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e8d7 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784959.230764:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784959.230764:0:22658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784959.230818:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9e8d0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e8d7 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784959.230825:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c0030400/0x88ace7295d9e8d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e8d7 expref: -99 pid: 23403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784959.230840:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784959.230841:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784959.230843:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784959.230891:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb2570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e11354d-250d-4393-8e0e-7593eb008ce7:3645:1874627750251648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784959.230921:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784959.230956:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750251648 00000100:00100000:0.0:1787784959.230960:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750251648 00010000:00010000:0.0:1787784959.230978:0:22655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951e1d34800/0x88ace7295d9e8d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e8d0 expref: 18 pid: 22662 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784959.230989:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784959.230994:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9e7cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e7d4 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784959.230999:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787784959.231001:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628200 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:2.0:1787784959.231005:0:22659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9e7cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9e7d4 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784959.231005:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbe5a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+18:3645:x1874627750251648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784959.231012:0:22659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9e7cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9e7d4 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784959.231016:0:22655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:2.0:1787784959.231019:0:22659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9e7cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9e7d4 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784959.231020:0:22655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951e1d34800/0x88ace7295d9e8d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e8d0 expref: 18 pid: 22662 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784959.231025:0:22659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787784959.231030:0:22655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951e1d34800/0x88ace7295d9e8d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9e8d0 expref: 18 pid: 22662 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784959.231041:0:22659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9e7cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e7d4 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784959.231045:0:22655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784959.231056:0:22659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784959.231073:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9e7cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e7d4 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784959.231079:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951d1628200/0x88ace7295d9e7cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e7d4 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784959.231080:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbe5a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+18:3645:x1874627750251648:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784959.231087:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787784959.231093:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784959.231094:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784959.231096:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784959.231108:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784959.231116:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e11354d-250d-4393-8e0e-7593eb008ce7:3647:1874627750251776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784959.231141:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784959.231170:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750251776 00000100:00100000:0.0:1787784959.231173:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750251776 00000100:00100000:2.0:1787784959.231180:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb2570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e11354d-250d-4393-8e0e-7593eb008ce7:3645:1874627750251648:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784959.231186:0:22656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951d1629c00/0x88ace7295d9e7d4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e7cd expref: 18 pid: 22664 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784959.231198:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784959.231200:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784959.231202:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784959.231218:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbe5b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e11354d-250d-4393-8e0e-7593eb008ce7+18:3647:x1874627750251776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784959.231226:0:22656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784959.231231:0:22656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951d1629c00/0x88ace7295d9e7d4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e7cd expref: 18 pid: 22664 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784959.231239:0:22656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951d1629c00/0x88ace7295d9e7d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9e7cd expref: 18 pid: 22664 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784959.231250:0:22656:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8951c151e400/0x88ace7295d9e92b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784959.231257:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c151e400/0x88ace7295d9e92b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784959.231270:0:22656:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951c151e400/0x88ace7295d9e92b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784959.231277:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951c151e400/0x88ace7295d9e92b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784959.231285:0:22656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8951c151e400/0x88ace7295d9e92b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784959.231301:0:22656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8951c151e400/0x88ace7295d9e92b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784959.231307:0:22656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151e400 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:0.0:1787784959.231312:0:22656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8951c151e400/0x88ace7295d9e92b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784959.231320:0:22656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8951c151e400/0x88ace7295d9e92b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784959.231328:0:22656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8951c151e400/0x88ace7295d9e92b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784959.231338:0:22656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787784959.231363:0:23825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d34800/0x88ace7295d9e8d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9e8d0 expref: 18 pid: 22662 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784959.231574:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbe5b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e11354d-250d-4393-8e0e-7593eb008ce7+18:3647:x1874627750251776:12345-0@lo:103:ldlm_bl.0 Request processed in 365us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784959.231580:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784959.231605:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e11354d-250d-4393-8e0e-7593eb008ce7:3647:1874627750251776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784959.231830:0:23825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c3c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23825:1874627750251392:0@lo:104: 00010000:00010000:3.0:1787784959.231844:0:23825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1629c00/0x88ace7295d9e7d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9e7cd expref: 16 pid: 22664 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784959.231852:0:23825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c1e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23825:1874627750251520:0@lo:104: 00010000:00010000:3.0:1787784959.231868:0:23825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8951c151e400/0x88ace7295d9e92b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784959.231877:0:23825:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8951c151e400/0x88ace7295d9e92b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784959.231883:0:23825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8951c151e400/0x88ace7295d9e92b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784959.231889:0:23825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c151e400/0x88ace7295d9e92b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784959.686299:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784960.709967:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787784960.901924:0:22668:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787784960.901932:0:22668:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951f81b5800 from 13 10000000:01000000:2.0:1787784960.901938:0:22668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787784960.901995:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9e932 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784960.902008:0:22668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9e932 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784960.902019:0:22668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9e932 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784960.902067:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750251904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787784960.902130:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784960.902173:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d1d0db40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784960.902440:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750251904 00000100:00100000:3.0:1787784960.902448:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750251904 00000100:00100000:3.0:1787784960.902509:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787784960.902519:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff08a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+16:22668:x1874627750251904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784960.902534:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784960.902548:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c151e400/0x88ace7295d9e939 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e932 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784960.902582:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c151e400/0x88ace7295d9e939 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e932 expref: 17 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784960.902604:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c151e400/0x88ace7295d9e939 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e932 expref: 17 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784960.902613:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c151e400, rc 0) 00000100:00100000:3.0:1787784960.902848:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff08a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+17:22668:x1874627750251904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 330us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784960.902856:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787784960.904183:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750251904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784960.904224:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9e932 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e939 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784960.904236:0:22668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9e932 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e939 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784960.904319:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750252032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784960.904380:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784960.907344:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951e0b086c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784960.914617:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750252032 00000100:00100000:3.0:1787784960.914632:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750252032 00000100:00100000:3.0:1787784960.914711:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787784960.914722:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+17:22668:x1874627750252032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784960.914935:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+17:22668:x1874627750252032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 215us (10555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784960.914944:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787784960.914983:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750252032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784960.915037:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe58b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750252160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784960.923220:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784960.923375:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d1d0d900 going to sleep for 11 seconds 00000100:00100000:1.0:1787784960.925948:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750252160 00000100:00100000:1.0:1787784960.925963:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750252160 00000100:00100000:1.0:1787784960.928913:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787784960.928933:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff08ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+17:22668:x1874627750252160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784960.929115:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff08ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+17:22668:x1874627750252160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (5900us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784960.929123:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787784960.929155:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe58b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750252160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787784960.931328:0:23900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787784960.931601:0:22668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787784960.931627:0:22668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787784960.931638:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9e932 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e939 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784960.931649:0:22668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9e932 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e939 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784960.931659:0:22668:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787784960.931662:0:22668:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951ff20c000 from 13 10000000:01000000:3.0:1787784960.931665:0:22668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787784960.931838:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c151fc00/0x88ace7295d9e940 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784960.931929:0:22668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951c151fc00/0x88ace7295d9e940 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784960.931943:0:22668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951c151fc00/0x88ace7295d9e940 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784960.931968:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750252288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784960.932101:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784960.932138:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24e8180 going to sleep for 11 seconds 00000100:00100000:0.0:1787784960.932430:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750252288 00000100:00100000:0.0:1787784960.932438:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750252288 00000100:00100000:0.0:1787784960.932487:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787784960.932496:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+17:22668:x1874627750252288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784960.932510:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784960.932524:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d35200/0x88ace7295d9e947 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e940 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784960.932555:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d35200/0x88ace7295d9e947 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e940 expref: 18 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784960.933816:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d35200/0x88ace7295d9e947 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e940 expref: 18 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784960.933827:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d35200, rc 0) 00000100:00100000:0.0:1787784960.934111:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+18:22668:x1874627750252288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1614us (2008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784960.934119:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787784960.934235:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750252288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784960.934254:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951c151fc00/0x88ace7295d9e940 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e947 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784960.934264:0:22668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951c151fc00/0x88ace7295d9e940 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e947 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784960.934340:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750252416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784960.934376:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784960.934414:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24e8180 going to sleep for 11 seconds 00000100:00100000:1.0:1787784960.934531:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750252416 00000100:00100000:1.0:1787784960.934538:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750252416 00000100:00100000:1.0:1787784960.934579:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787784960.934589:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+18:22668:x1874627750252416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784960.934713:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+18:22668:x1874627750252416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784960.934720:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787784960.935405:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750252416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784960.935441:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb257480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750252544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784960.935488:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784960.935527:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951f53eb600 going to sleep for 11 seconds 00000100:00100000:3.0:1787784960.935574:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750252544 00000100:00100000:3.0:1787784960.935578:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750252544 00000100:00100000:3.0:1787784960.935613:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787784960.935620:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+18:22668:x1874627750252544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784960.935970:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+18:22668:x1874627750252544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 350us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784960.935978:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787784960.938151:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb257480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750252544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787784960.953258:0:23901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787784960.953491:0:22668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787784960.953518:0:22668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787784960.953529:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951c151fc00/0x88ace7295d9e940 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e947 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784960.953541:0:22668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951c151fc00/0x88ace7295d9e940 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e947 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784961.159024:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784951/real 1787784951] req@ffff8951fbe59680 x1874627750246656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784961 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784961.159053:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8951fbe59680 x1874627750246656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784961 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784961.159069:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784951/real 1787784951] req@ffff8951fd7c0f00 x1874627750246016/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784961 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784961.159081:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8951fd7c0f00 x1874627750246016/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784961 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784961.159090:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784946/real 1787784946] req@ffff8951d1b5fc00 x1874627750244096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784961 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784961.159114:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8951d1b5fc00 x1874627750244096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784961 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784961.159125:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784946/real 1787784946] req@ffff8951d1b5e940 x1874627750244224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784961 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784961.159137:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8951d1b5e940 x1874627750244224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784961 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787784961.159157:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c259a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784961.159222:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787784961.159226:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750246656:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787784961.159232:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951fa9c5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787784961.159343:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787784961.159348:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787784961.159350:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787784961.159352:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787784961.159381:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787784961.159383:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787784961.159386:0:38:0:(import.c:65:import_set_state_nolock()) ffff8951fa9c5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787784961.159391:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 692 00000100:00080000:3.0:1787784961.159397:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787784961.159403:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8951fa9c5800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1787784961.159422:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fd7c1680 x1874627750253056/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787784961.159431:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787784961.159434:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787784961.159436:0:38:0:(import.c:65:import_set_state_nolock()) ffff8950c259a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787784961.159438:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 692 00000100:00080000:3.0:1787784961.159441:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787784961.159443:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8950c259a000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1787784961.159452:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fd7c0780 x1874627750253184/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787784961.159481:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750253312:0@lo:400:kworker.0 00000100:00100000:3.0:1787784961.159544:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784961.159590:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787784961.159596:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750252672:0@lo:400:kworker.0 00000100:00100000:3.0:1787784961.159626:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784961.159652:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750252800:0@lo:400:kworker.0 00000100:00100000:3.0:1787784961.159673:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784961.159688:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784961.159693:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750252928:0@lo:400:kworker.0 00000100:00100000:3.0:1787784961.159709:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784961.159739:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750253312 00000100:00100000:3.0:1787784961.159745:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750253312 00000100:00100000:3.0:1787784961.159816:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750252800 00000100:00100000:3.0:1787784961.159820:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750252800 00000100:00100000:3.0:1787784961.159837:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787784961.159844:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750253312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784961.159908:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750253312:12345-0@lo:400:kworker.0 Request processed in 63us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784961.159915:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787784961.159933:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787784961.159939:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff020b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750252800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784961.159968:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff020b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750252800:12345-0@lo:400:kworker.0 Request processed in 30us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784961.159974:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787784961.159991:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750252672 00000100:00100000:3.0:1787784961.159995:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750252672 00000100:00100000:3.0:1787784961.160015:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750252928 00000100:00100000:3.0:1787784961.160018:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750252928 00000100:00100000:3.0:1787784961.160028:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787784961.160034:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1874627750252672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784961.160063:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1874627750252672:12345-0@lo:400:kworker.0 Request processed in 29us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784961.160076:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787784961.160087:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787784961.160093:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff022d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750252928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784961.160121:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff022d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750252928:12345-0@lo:400:kworker.0 Request processed in 29us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784961.160127:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787784961.160168:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750252928:0@lo:400:kworker.0 00010000:00080000:3.0:1787784961.160180:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951fd7c03c0 x1874627750252800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784961.160188:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750252800:0@lo:400:kworker.0 00000100:00100000:3.0:1787784961.160220:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750252672:0@lo:400:kworker.0 00010000:00080000:3.0:1787784961.160230:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951fd7c1e00 x1874627750253312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784961.160238:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750253312:0@lo:400:kworker.0 00000100:00080000:2.0:1787784961.160540:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787784961.160553:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750246016:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787784961.160653:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787784961.160658:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787784961.160660:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787784961.160663:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787784961.160676:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c41fa800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787784961.160717:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787784961.160721:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750244096:0@lo:8:kworker.0 00000100:00080000:3.0:1787784961.160736:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951f67dc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784961.160760:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784961.160764:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787784961.160813:0:38:0:(import.c:65:import_set_state_nolock()) ffff8950c41fa800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787784961.160817:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 687 00000100:00080000:2.0:1787784961.160822:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787784961.160827:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8950c41fa800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784961.160853:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fbe59e00 x1874627750253440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787784961.160876:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784961.160878:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787784961.160885:0:38:0:(import.c:65:import_set_state_nolock()) ffff8951f67dc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787784961.160888:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 687 00000100:00080000:2.0:1787784961.160891:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787784961.160894:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8951f67dc000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1787784961.160908:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fbe58b40 x1874627750253568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787784961.161050:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787784961.161055:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750244224:0@lo:8:kworker.0 00000100:00100000:3.0:1787784961.161081:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750253056:0@lo:8:kworker.0 00000400:00000100:3.0:1787784961.161118:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627750253056 offset 0 length 520: 4 00000100:00100000:3.0:1787784961.161145:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750253184:0@lo:8:kworker.0 00000400:00000100:3.0:1787784961.161163:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627750253184 offset 0 length 520: 4 00000100:00100000:3.0:1787784961.161175:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750253440:0@lo:8:kworker.0 00000400:00000100:3.0:1787784961.161189:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627750253440 offset 0 length 520: 4 00000100:00100000:3.0:1787784961.161198:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750253568:0@lo:8:kworker.0 00000400:00000100:3.0:1787784961.161213:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627750253568 offset 0 length 520: 4 00010000:00010000:2.0:1787784961.735141:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784962.184634:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750253696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787784962.184722:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784962.184909:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750253696 00000100:00100000:2.0:1787784962.184918:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750253696 00000100:00100000:2.0:1787784962.184974:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787784962.184984:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff022580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750253696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787784962.185022:0:23412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787784962.185086:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff022580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750253696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784962.185093:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787784962.185137:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750253696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787784962.185367:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb255e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750253824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787784962.185396:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784962.185528:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750253824 00000100:00100000:0.0:1787784962.185532:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750253824 00000100:00100000:0.0:1787784962.185568:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787784962.185575:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff020f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750253824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787784962.185593:0:22675:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787784962.185632:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff020f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750253824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784962.185654:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787784962.185806:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb255e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750253824:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1787784962.714968:0:23404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787784962.764560:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787784963.145488:0:23428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787784963.782338:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784964.806024:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784965.829914:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787784966.176147:0:24175:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787784966.176151:0:24175:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787784966.176153:0:24175:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787784966.176281:0:24175:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8951ebf32800 00000020:01000004:2.0:1787784966.176299:0:24175:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787784966.176316:0:24175:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787784966.176334:0:24175:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8951f02dcd28) 00000020:00000080:2.0:1787784966.176353:0:24175:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787784966.228240:0:24175:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787784966.230488:0:24175:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787784966.231083:0:24175:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787784966.235418:0:24175:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787784966.236025:0:24175:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787784966.236249:0:24175:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787784966.236467:0:24175:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:3.0:1787784966.240559:0:24175:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787784966.240726:0:24175:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787784966.240753:0:24175:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787784966.240763:0:24175:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x88ace7295d9e955 00000020:01000004:3.0:1787784966.240801:0:24175:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787784966.240824:0:24175:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.141@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787784966.240834:0:24175:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787784966.240840:0:24175:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787784966.240846:0:24175:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787784966.240856:0:24175:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8951fb388000) 00000020:00000080:3.0:1787784966.240868:0:24175:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1787784966.242000:0:24175:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784966.242173:0:24175:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787784966.242179:0:24175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787784966.247369:0:24175:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787784966.247388:0:24175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787784966.253822:0:24175:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787784966.253839:0:24175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787784966.256092:0:24175:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787784966.256282:0:24175:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787784966.256287:0:24175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787784966.265971:0:24175:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787784966.265984:0:24175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00080000:2.0:1787784966.278965:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784966.278973:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784966.278977:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784966.278980:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784966.278997:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784966.279000:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784966.279003:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784966.279006:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787784966.279012:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750254336:0@lo:400:kworker.0 00000100:00100000:2.0:1787784966.279028:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750254080:0@lo:400:kworker.0 00000100:00100000:3.0:1787784966.282132:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e11354d-250d-4393-8e0e-7593eb008ce7:3645:1874627750253952:0@lo:400:kworker.0 00000100:00100000:0.0:1787784966.283209:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784966.283494:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750254336 00000100:00100000:0.0:1787784966.283503:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750254336 00000100:00100000:2.0:1787784966.283901:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784966.283937:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784966.283947:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750254208:0@lo:400:kworker.0 00000100:00100000:2.0:1787784966.283983:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784966.284014:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750254080 00000100:00100000:2.0:1787784966.284018:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750254080 00000100:00100000:2.0:1787784966.284040:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787784966.284048:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750254336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784966.284109:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750254336:12345-0@lo:400:kworker.0 Request processed in 62us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784966.284129:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787784966.284146:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787784966.284151:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750254080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784966.284186:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750254080:12345-0@lo:400:kworker.0 Request processed in 35us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784966.284191:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787784966.284213:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750254208 00000100:00100000:2.0:1787784966.284216:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750254208 00000100:00100000:2.0:1787784966.284240:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787784966.284403:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784966.284430:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750254464:0@lo:400:kworker.0 00000100:00100000:2.0:1787784966.284438:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750254208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784966.284452:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784966.284479:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750253952 00000100:00100000:3.0:1787784966.284483:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750253952 00000100:00100000:2.0:1787784966.284485:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874627750254208:12345-0@lo:400:kworker.0 Request processed in 51us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784966.284491:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787784966.284500:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750254464 00000100:00100000:2.0:1787784966.284503:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750254464 00000100:00100000:3.0:1787784966.284518:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787784966.284518:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787784966.284523:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff021680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750254464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784966.284524:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+18:3645:x1874627750253952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784966.284553:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff021680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750254464:12345-0@lo:400:kworker.0 Request processed in 30us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784966.284559:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787784966.284816:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+18:3645:x1874627750253952:12345-0@lo:400:kworker.0 Request processed in 291us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784966.284823:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787784966.284853:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e11354d-250d-4393-8e0e-7593eb008ce7:3645:1874627750253952:0@lo:400:kworker.0 00010000:00080000:2.0:1787784966.284866:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951cffc83c0 x1874627750254464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784966.284879:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750254464:0@lo:400:kworker.0 00010000:00080000:2.0:1787784966.284910:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951cffc9a40 x1874627750254208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784966.284927:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874627750254208:0@lo:400:kworker.0 00000100:00100000:2.0:1787784966.284941:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750254080:0@lo:400:kworker.0 00000100:00100000:2.0:1787784966.284969:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750254336:0@lo:400:kworker.0 00000100:00100000:1.0:1787784966.304010:0:24175:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787784966.304297:0:24175:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787784966.304309:0:24175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787784966.306048:0:24175:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787784966.306059:0:24175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787784966.306920:0:24175:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787784966.306929:0:24175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787784966.312055:0:24175:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784966.312365:0:24175:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787784966.312372:0:24175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787784966.313434:0:24175:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787784966.313445:0:24175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787784966.358908:0:24175:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784966.359175:0:24175:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787784966.359182:0:24175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787784966.366553:0:24175:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787784966.366577:0:24175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787784966.367178:0:24175:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787784966.367210:0:24175:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1787784966.367219:0:24175:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.141@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787784966.380098:0:24175:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787784966.380142:0:24175:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.141@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787784966.380147:0:24175:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787784966.380149:0:24175:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787784966.380150:0:24175:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784966.380152:0:24175:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784966.380153:0:24175:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784966.380154:0:24175:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784966.380155:0:24175:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784966.380157:0:24175:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784966.380158:0:24175:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787784966.380161:0:24175:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787784966.380163:0:24175:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787784966.380164:0:24175:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787784966.380170:0:24175:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784966.380171:0:24175:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784966.380172:0:24175:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784966.380172:0:24175:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784966.380173:0:24175:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784966.380174:0:24175:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784966.380175:0:24175:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787784966.380209:0:24175:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787784966.380230:0:24175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750254592:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787784966.380305:0:24175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784966.380414:0:24175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df66de40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784966.381119:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750254592 00000100:00100000:3.0:1787784966.381127:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750254592 00000100:00100000:3.0:1787784966.381222:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787784966.381232:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+18:24175:x1874627750254592:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787784966.381266:0:22662:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787784966.381269:0:22662:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787784966.381273:0:22662:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787784966.382840:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+18:24175:x1874627750254592:12345-0@lo:253:mount.lustre.0 Request processed in 1602us (2528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784966.382869:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787784966.382975:0:24175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750254592:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787784966.382992:0:24175:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787784966.382996:0:24175:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787784966.382997:0:24175:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787784966.382999:0:24175:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784966.383000:0:24175:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784966.383001:0:24175:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784966.383003:0:24175:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784966.383004:0:24175:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784966.383006:0:24175:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784966.383008:0:24175:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787784966.383049:0:24175:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8951ebf32800 from lustre-OST0000 10000000:01000000:2.0:1787784966.383077:0:24175:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787784966.383079:0:24175:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787784966.383086:0:24175:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8951ebd519b8 local copy 00010000:00010000:2.0:1787784966.383095:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e717 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784966.383185:0:24175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750254720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784966.383215:0:24175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784966.383252:0:24175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df66d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784966.383329:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750254720 00000100:00100000:0.0:1787784966.383336:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750254720 00000100:00100000:0.0:1787784966.383452:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787784966.383464:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+18:24175:x1874627750254720:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784966.383590:0:24175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750254720:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787784966.383623:0:24175:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787784966.383640:0:24175:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787784966.383646:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e717 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784966.383655:0:24175:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e717 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784966.383678:0:24175:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8951ebf32800 10000000:01000000:2.0:1787784966.383683:0:24175:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787784966.383688:0:24175:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787784966.383690:0:24175:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787784966.383694:0:24175:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787784966.383697:0:24175:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787784966.383720:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784966.383738:0:24175:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784966.383748:0:24175:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784966.383761:0:24175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750254848:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787784966.383761:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+18:24175:x1874627750254720:12345-0@lo:501:mount.lustre.0 Request processed in 82us (327us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787784966.383789:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787784966.383804:0:24175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784966.383824:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750254848 00000100:00100000:0.0:1787784966.383828:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750254848 00000100:00100000:2.0:1787784966.383836:0:24175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df66d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784966.383842:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787784966.383847:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+18:24175:x1874627750254848:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784966.383856:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784966.383870:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951e1d35c00/0x88ace7295d9e96a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e963 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784966.383892:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951e1d35c00/0x88ace7295d9e96a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e963 expref: 19 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784966.383904:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951e1d35c00/0x88ace7295d9e96a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e963 expref: 19 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784966.383913:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d35c00, rc 0) 00000100:00100000:0.0:1787784966.383950:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+19:24175:x1874627750254848:12345-0@lo:101:mount.lustre.0 Request processed in 103us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784966.383962:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787784966.384001:0:24175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750254848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784966.384012:0:24175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e963 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e96a expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784966.384024:0:24175:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e963 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e96a expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787784966.385720:0:24175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1787784966.386562:0:24175:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784966.388040:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1787784966.388074:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1787784966.388083:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1787784966.388090:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1787784966.388098:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1787784966.388105:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1787784966.388112:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1787784966.388119:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1787784966.388128:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1787784966.388135:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1787784966.388141:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1787784966.388148:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1787784966.388161:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1787784966.388164:0:24175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1787784966.388266:0:24175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750254976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784966.388332:0:24175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784966.388371:0:24175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df66d300 going to sleep for 11 seconds 00000100:00100000:3.0:1787784966.388725:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750254976 00000100:00100000:3.0:1787784966.388743:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750254976 00000100:00100000:3.0:1787784966.388870:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787784966.388881:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+19:24175:x1874627750254976:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784966.389053:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+19:24175:x1874627750254976:12345-0@lo:501:mount.lustre.0 Request processed in 173us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784966.389061:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787784966.389162:0:24175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750254976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784966.389196:0:24175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750255104:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787784966.389237:0:24175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784966.389417:0:24175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df66d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787784966.389565:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750255104 00000100:00100000:0.0:1787784966.389570:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750255104 00000100:00100000:0.0:1787784966.389598:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787784966.389618:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+19:24175:x1874627750255104:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784966.390513:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+19:24175:x1874627750255104:12345-0@lo:503:mount.lustre.0 Request processed in 890us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784966.390523:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787784966.390709:0:24175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750255104:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787784966.391190:0:24175:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787784966.391264:0:24175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750255232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784966.391310:0:24175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784966.391337:0:24175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df66d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784966.391410:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750255232 00000100:00100000:0.0:1787784966.391416:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750255232 00000100:00100000:0.0:1787784966.391447:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787784966.391456:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+19:24175:x1874627750255232:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784966.392023:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+19:24175:x1874627750255232:12345-0@lo:502:mount.lustre.0 Request processed in 567us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784966.392030:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787784966.392115:0:24175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750255232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787784966.392316:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1787784966.392342:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1787784966.392355:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1787784966.392367:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1787784966.392378:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1787784966.392404:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1787784966.392416:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1787784966.392444:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1787784966.392458:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1787784966.392468:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1787784966.392479:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1787784966.392491:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1787784966.392516:0:24175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750255360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784966.392558:0:24175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784966.392590:0:24175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df66d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784966.392706:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750255360 00000100:00100000:0.0:1787784966.392712:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750255360 00000100:00100000:0.0:1787784966.392746:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787784966.392789:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+19:24175:x1874627750255360:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784966.392862:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+19:24175:x1874627750255360:12345-0@lo:502:mount.lustre.0 Request processed in 74us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784966.392870:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787784966.393112:0:24175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750255360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787784966.393152:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1787784966.393159:0:24175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1787784966.393968:0:24192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787784966.393978:0:24192:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1787784966.393987:0:24192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784966.393990:0:24192:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787784966.393996:0:24192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787784966.394019:0:24192:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8951f02d8000) 00000020:00000080:2.0:1787784966.394044:0:24192:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787784966.394051:0:24192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787784966.394138:0:24192:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951ebf32800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787784966.394147:0:24192:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787784966.394154:0:24192:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x88ace7295d9e978 00010000:00010000:2.0:1787784966.409169:0:24192:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1787784966.409721:0:24192:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1787784966.412259:0:24192:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1787784966.419875:0:24192:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787784966.419889:0:24192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784966.419895:0:24192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784966.419897:0:24192:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787784966.419900:0:24192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787784966.419903:0:24192:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1787784966.419905:0:24192:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787784966.419906:0:24192:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787784966.419908:0:24192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787784966.419910:0:24192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784966.419911:0:24192:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787784966.419913:0:24192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784966.419916:0:24192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784966.419917:0:24192:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787784966.419920:0:24192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787784966.419922:0:24192:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787784966.419923:0:24192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784966.419925:0:24192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784966.419927:0:24192:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787784966.419929:0:24192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784966.419931:0:24192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784966.419932:0:24192:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787784966.419935:0:24192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787784966.419965:0:24192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784966.419967:0:24192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784966.419982:0:24192:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787784966.419985:0:24192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1787784966.420155:0:24175:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787784966.420184:0:24175:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787784966.420207:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e963 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e96a expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.420219:0:24175:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1628800/0x88ace7295d9e963 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e96a expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784966.420227:0:24175:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951ebf32800 from 1 10000000:01000000:1.0:1787784966.420229:0:24175:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787784966.420268:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9e97f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.420275:0:24175:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9e97f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.420285:0:24175:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9e97f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784966.420308:0:24175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750255488:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787784966.420372:0:24175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784966.420431:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750255488 00000100:00100000:1.0:1787784966.420445:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750255488 00000100:00100000:1.0:1787784966.420510:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787784966.420518:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+19:24175:x1874627750255488:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784966.420533:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784966.420545:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df602a00/0x88ace7295d9e986 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e97f expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.420571:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df602a00/0x88ace7295d9e986 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e97f expref: 20 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.420582:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df602a00/0x88ace7295d9e986 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e97f expref: 20 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.420592:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602a00, rc 0) 00000100:00100000:1.0:1787784966.420625:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+20:24175:x1874627750255488:12345-0@lo:101:mount.lustre.0 Request processed in 108us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784966.420631:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787784966.420672:0:24175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d8380c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787784966.420691:0:24175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750255488:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784966.420705:0:24175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9e97f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e986 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.420713:0:24175:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9e97f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e986 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787784966.433080:0:24175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1787784966.433381:0:24175:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784966.433743:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787784966.433925:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1787784966.433945:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1787784966.433962:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1787784966.433976:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1787784966.433989:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1787784966.434000:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1787784966.434011:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1787784966.434022:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1787784966.434033:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1787784966.434047:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1787784966.434064:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1787784966.434068:0:24175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1787784966.434149:0:24175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff022940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750255616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784966.434223:0:24175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784966.434313:0:24175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c36856c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784966.434361:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750255616 00000100:00100000:1.0:1787784966.434369:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750255616 00000100:00100000:1.0:1787784966.434543:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787784966.434554:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+20:24175:x1874627750255616:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784966.434745:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+20:24175:x1874627750255616:12345-0@lo:501:mount.lustre.0 Request processed in 193us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784966.434753:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787784966.435083:0:24175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff022940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750255616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784966.435120:0:24175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff022940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750255744:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787784966.435171:0:24175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784966.435242:0:24175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c36856c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784966.435272:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750255744 00000100:00100000:1.0:1787784966.435277:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750255744 00000100:00100000:1.0:1787784966.435339:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787784966.435346:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+20:24175:x1874627750255744:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784966.435438:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+20:24175:x1874627750255744:12345-0@lo:503:mount.lustre.0 Request processed in 91us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784966.435446:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787784966.435508:0:24175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff022940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750255744:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787784966.435921:0:24175:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787784966.435988:0:24175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff022940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750255872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784966.436021:0:24175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784966.436797:0:24175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c36856c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784966.436913:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750255872 00000100:00100000:2.0:1787784966.436919:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750255872 00000100:00100000:2.0:1787784966.436951:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787784966.436960:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+20:24175:x1874627750255872:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784966.437081:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+20:24175:x1874627750255872:12345-0@lo:502:mount.lustre.0 Request processed in 122us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784966.437089:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787784966.437171:0:24175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff022940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750255872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787784966.437457:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1787784966.437488:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1787784966.437503:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1787784966.437517:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1787784966.437532:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1787784966.437547:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1787784966.437561:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1787784966.437574:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1787784966.437587:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1787784966.437599:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1787784966.437697:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1787784966.437725:0:24175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff022940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750256000:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784966.437861:0:24175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784966.437920:0:24175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c36856c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784966.440499:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750256000 00000100:00100000:1.0:1787784966.440516:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750256000 00000100:00100000:0.0:1787784966.441819:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787784966.441839:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+20:24175:x1874627750256000:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784966.442045:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+20:24175:x1874627750256000:12345-0@lo:502:mount.lustre.0 Request processed in 213us (4182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784966.442060:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787784966.442182:0:24175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff022940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750256000:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787784966.442266:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1787784966.442281:0:24175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1787784966.446258:0:24196:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784966.446270:0:24196:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784966.446273:0:24196:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787784966.446283:0:24196:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8951ebf32800 00000020:00000080:2.0:1787784966.446286:0:24196:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787784966.446294:0:24196:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784966.446296:0:24196:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784966.446298:0:24196:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787784966.446300:0:24196:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784966.446302:0:24196:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784966.446304:0:24196:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787784966.446307:0:24196:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8951ebf32800 00000020:00000080:2.0:1787784966.446309:0:24196:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787784966.446474:0:24196:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784966.446480:0:24196:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784966.446482:0:24196:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787784966.446485:0:24196:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784966.446487:0:24196:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784966.446488:0:24196:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787784966.446493:0:24196:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8951ebf32800 00000020:00000080:2.0:1787784966.446495:0:24196:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787784966.448948:0:24196:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784966.448962:0:24196:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784966.448971:0:24196:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787784966.448976:0:24196:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784966.448981:0:24196:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784966.448983:0:24196:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787784966.448989:0:24196:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8951ebf32800 00000020:00000080:2.0:1787784966.448992:0:24196:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787784966.449056:0:24196:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784966.449060:0:24196:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784966.449061:0:24196:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787784966.449065:0:24196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1787784966.455339:0:24175:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787784966.455393:0:24175:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787784966.455419:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9e97f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e986 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.455431:0:24175:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9e97f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e986 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784966.455538:0:24175:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787784966.455541:0:24175:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8951ebf32800 10000000:01000000:1.0:1787784966.455545:0:24175:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8951ebf32800 10000000:01000000:1.0:1787784966.455549:0:24175:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787784966.455556:0:24175:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8951ebf32800 from 1 10000000:01000000:1.0:1787784966.455558:0:24175:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787784966.455598:0:24175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df602600/0x88ace7295d9e98d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.455823:0:24175:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951df602600/0x88ace7295d9e98d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.455836:0:24175:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951df602600/0x88ace7295d9e98d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784966.455862:0:24175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750256128:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787784966.455932:0:24175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784966.455969:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750256128 00000100:00100000:1.0:1787784966.455975:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750256128 00000100:00100000:1.0:1787784966.456009:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787784966.456015:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+20:24175:x1874627750256128:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784966.456026:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784966.456036:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df603200/0x88ace7295d9e994 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e98d expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.456055:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df603200/0x88ace7295d9e994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e98d expref: 21 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.456063:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df603200/0x88ace7295d9e994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e98d expref: 21 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.456069:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603200, rc 0) 00000100:00100000:1.0:1787784966.456092:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+21:24175:x1874627750256128:12345-0@lo:101:mount.lustre.0 Request processed in 78us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784966.456097:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787784966.456129:0:24175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d8380000 going to sleep for 11 seconds 00000100:00100000:1.0:1787784966.456149:0:24175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750256128:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784966.456159:0:24175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951df602600/0x88ace7295d9e98d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e994 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.456165:0:24175:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951df602600/0x88ace7295d9e98d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e994 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787784966.469545:0:24175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1787784966.471049:0:24175:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787784966.473530:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787784966.473586:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1787784966.473758:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1787784966.473794:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1787784966.473809:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1787784966.473822:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1787784966.473832:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1787784966.473843:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1787784966.473854:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787784966.473867:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1787784966.473879:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1787784966.473891:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1787784966.473902:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1787784966.473933:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1787784966.473947:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1787784966.473959:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1787784966.473971:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1787784966.473981:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1787784966.473992:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1787784966.474002:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1787784966.474014:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1787784966.474027:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1787784966.474038:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1787784966.474060:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1787784966.474071:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1787784966.474083:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1787784966.474094:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1787784966.474105:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1787784966.474119:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1787784966.474144:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1787784966.474157:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1787784966.474169:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1787784966.474181:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1787784966.474193:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1787784966.474205:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1787784966.474217:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1787784966.474229:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1787784966.474240:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1787784966.477476:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1787784966.477505:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1787784966.477518:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1787784966.477531:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1787784966.477557:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1787784966.477573:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1787784966.477589:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1787784966.477760:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1787784966.477798:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1787784966.477812:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1787784966.477972:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1787784966.477991:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1787784966.478007:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1787784966.478012:0:24175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1787784966.478169:0:24175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750256256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784966.480811:0:24175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784966.480884:0:24175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d83806c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784966.481350:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750256256 00000100:00100000:0.0:1787784966.481359:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750256256 00000100:00100000:0.0:1787784966.481508:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787784966.481521:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+21:24175:x1874627750256256:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784966.481884:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+21:24175:x1874627750256256:12345-0@lo:501:mount.lustre.0 Request processed in 365us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784966.481892:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787784966.482071:0:24175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750256256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784966.482126:0:24175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750256384:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784966.482179:0:24175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784966.482269:0:24175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d83806c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784966.484199:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750256384 00000100:00100000:0.0:1787784966.484214:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750256384 00000100:00100000:0.0:1787784966.484472:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787784966.484484:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+21:24175:x1874627750256384:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784966.484888:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+21:24175:x1874627750256384:12345-0@lo:503:mount.lustre.0 Request processed in 405us (2708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784966.484897:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787784966.485018:0:24175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750256384:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787784966.485525:0:24175:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787784966.485635:0:24175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750256512:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784966.485688:0:24175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784966.486195:0:24175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df66d480 going to sleep for 11 seconds 00000100:00100000:1.0:1787784966.486236:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750256512 00000100:00100000:1.0:1787784966.486253:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750256512 00000100:00100000:1.0:1787784966.486289:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787784966.486298:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+21:24175:x1874627750256512:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784966.486533:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+21:24175:x1874627750256512:12345-0@lo:502:mount.lustre.0 Request processed in 235us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784966.486551:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787784966.486786:0:24175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750256512:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787784966.487006:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1787784966.487035:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1787784966.487051:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1787784966.487067:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1787784966.487081:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1787784966.487095:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1787784966.487109:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1787784966.487123:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1787784966.487136:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1787784966.487149:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1787784966.487180:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1787784966.487196:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1787784966.487209:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1787784966.487223:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1787784966.487261:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1787784966.487278:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1787784966.487292:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1787784966.487305:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1787784966.487318:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1787784966.487331:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1787784966.487344:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1787784966.487357:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1787784966.487370:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1787784966.487520:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1787784966.487540:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1787784966.487568:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1787784966.487597:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1787784966.487763:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1787784966.487813:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1787784966.487827:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1787784966.487839:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1787784966.487850:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1787784966.487862:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1787784966.487874:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1787784966.487887:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1787784966.487900:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1787784966.487909:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1787784966.487922:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1787784966.487935:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1787784966.487946:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1787784966.487959:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1787784966.487970:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1787784966.488000:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1787784966.488016:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1787784966.488029:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1787784966.488041:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1787784966.488052:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1787784966.488070:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1787784966.488115:0:24175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750256640:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784966.488177:0:24175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784966.488215:0:24175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df66d480 going to sleep for 11 seconds 00000100:00100000:1.0:1787784966.488352:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750256640 00000100:00100000:1.0:1787784966.488358:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750256640 00000100:00100000:1.0:1787784966.488403:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787784966.488412:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+21:24175:x1874627750256640:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784966.488508:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+21:24175:x1874627750256640:12345-0@lo:502:mount.lustre.0 Request processed in 98us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784966.488516:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787784966.488845:0:24175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750256640:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787784966.489036:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1787784966.489058:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1787784966.489083:0:24175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750256768:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784966.489120:0:24175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784966.489140:0:24175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df66d480 going to sleep for 11 seconds 00000100:00100000:1.0:1787784966.489458:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750256768 00000100:00100000:1.0:1787784966.489464:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750256768 00000100:00100000:1.0:1787784966.489489:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787784966.489495:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+21:24175:x1874627750256768:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784966.489719:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+21:24175:x1874627750256768:12345-0@lo:502:mount.lustre.0 Request processed in 222us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784966.489735:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787784966.490073:0:24175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750256768:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787784966.490134:0:24175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1787784966.490143:0:24175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787784966.491529:0:24201:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787784966.491702:0:24201:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8951fd7b99b8) 00000020:00000080:0.0:1787784966.491740:0:24201:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1787784966.492516:0:24201:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951ebf32800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787784966.492522:0:24201:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951ebf32800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787784966.492525:0:24201:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951ebf32800 3 00010000:00080000:0.0:1787784966.492703:0:24201:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8950c1b36000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.141@tcp at head 00010000:00010000:0.0:1787784966.496446:0:24201:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1787784966.496821:0:24201:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787784966.496866:0:24201:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787784966.496880:0:24201:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x88ace7295d9e9a2 00000100:00080000:0.0:1787784966.496891:0:24201:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787784966.496908:0:24201:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8950c1b36000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784966.496942:0:24201:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fb256d00 x1874627750256896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787784966.496985:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb256d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874627750256896:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787784966.497052:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787784966.497118:0:24201:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787784966.497360:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750256896 00000100:00100000:2.0:1787784966.497368:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750256896 00000100:00100000:2.0:1787784966.497411:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784966.497419:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb2570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1874627750256896:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787784966.497445:0:22671:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 706 last 0 00000020:00000080:2.0:1787784966.497487:0:22671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x88ace7295d9e9a9 00000004:00100000:2.0:1787784966.497505:0:22671:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787784966.497559:0:22671:0:(import.c:65:import_set_state_nolock()) ffff8951fc5ec000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787784966.497748:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb2570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1874627750256896:12345-0@lo:38:llog_process_th.0 Request processed in 327us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784966.497757:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787784966.497822:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784966.497826:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784966.497837:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784966.497839:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784966.497843:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784966.497845:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784966.497847:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784966.497850:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:0.0:1787784966.498802:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951fb256d00 x1874627750256896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784966.498815:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787784966.498825:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1787784966.498833:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787784966.498838:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787784966.498841:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c1b36000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787784966.498847:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb256d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1874627750256896:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1787784966.498976:0:24201:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787784966.498993:0:24201:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8950c25b3370) 00000020:00000080:0.0:1787784966.499014:0:24201:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1787784966.499089:0:24201:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951ebf32800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787784966.499093:0:24201:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951ebf32800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787784966.499095:0:24201:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951ebf32800 3 00010000:00080000:0.0:1787784966.499121:0:24201:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8950c1b37800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.141@tcp at head 00010000:00010000:0.0:1787784966.507830:0:24201:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1787784966.508054:0:24201:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787784966.508099:0:24201:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787784966.508112:0:24201:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x88ace7295d9e9b7 00000100:00080000:0.0:1787784966.508124:0:24201:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787784966.508135:0:24201:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8950c1b37800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1787784966.508171:0:24201:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fb256d00 x1874627750257024/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784966.508193:0:24201:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787784966.508455:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784966.508461:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784966.508464:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784966.508467:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784966.508471:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784966.508473:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784966.508476:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784966.508478:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787784966.510724:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb256d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1874627750257024:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787784966.510823:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1787784966.510991:0:24201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1787784966.512124:0:24175:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787784966.512160:0:24175:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787784966.512178:0:24175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df602600/0x88ace7295d9e98d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e994 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784966.512191:0:24175:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951df602600/0x88ace7295d9e98d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e994 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784966.513338:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750257024 00000020:01000004:0.0:1787784966.513343:0:24175:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787784966.513345:0:24175:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787784966.513347:0:24175:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784966.513348:0:24175:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784966.513349:0:24175:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:3.0:1787784966.513350:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750257024 00000020:01000004:0.0:1787784966.513351:0:24175:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784966.513352:0:24175:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787784966.513354:0:24175:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784966.513355:0:24175:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787784966.513360:0:24175:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787784966.513363:0:24175:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787784966.513364:0:24175:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787784966.513366:0:24175:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784966.513367:0:24175:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784966.513368:0:24175:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784966.513369:0:24175:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784966.513369:0:24175:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787784966.513370:0:24175:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784966.513376:0:24175:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1787784966.513398:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787784966.513406:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb254f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1874627750257024:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787784966.513438:0:22669:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 706 last 0 10000000:01000000:0.0:1787784966.513467:0:24175:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000020:00000080:3.0:1787784966.513474:0:22669:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x88ace7295d9e9be 00000100:00100000:0.0:1787784966.513486:0:24175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb256580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750257152:0@lo:253:mount.lustre.0 00000004:00100000:3.0:1787784966.513489:0:22669:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787784966.513519:0:22669:0:(import.c:65:import_set_state_nolock()) ffff8951c4561800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784966.513556:0:24175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784966.513579:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb254f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1874627750257024:12345-0@lo:38:llog_process_th.0 Request processed in 173us (2755us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784966.513586:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787784966.514364:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8951fb256d00 x1874627750257024/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784966.514376:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787784966.514455:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1787784966.514463:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787784966.514468:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787784966.514471:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c1b37800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787784966.514477:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb256d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1874627750257024:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787784966.514519:0:24175:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c2247540 going to sleep for 11 seconds 00000100:00100000:0.0:1787784966.516459:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750257152 00000100:00100000:0.0:1787784966.516472:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750257152 00000100:00100000:0.0:1787784966.516536:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787784966.516556:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+21:24175:x1874627750257152:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787784966.516590:0:22662:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787784966.517034:0:22662:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787784966.529528:0:22662:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787784966.529553:0:22662:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787784966.529963:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+21:24175:x1874627750257152:12345-0@lo:253:mount.lustre.0 Request processed in 13414us (16400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784966.529976:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 20000000:01000000:1.0:1787784966.530406:0:22685:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787784966.530417:0:22685:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787784966.530437:0:22685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8951df603800/0x88ace7295d9e9c5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.530453:0:22685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951d1628c00/0x88ace7295d9e90f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e908 expref: 20 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.530462:0:22685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951d1629e00/0x88ace7295d9e91d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e916 expref: 20 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.530469:0:22685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8951df603800/0x88ace7295d9e9c5 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.530506:0:22685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951d1629e00/0x88ace7295d9e91d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9e916 expref: 20 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.530520:0:22685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951d1629e00/0x88ace7295d9e91d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9e916 expref: 20 pid: 22663 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784966.530534:0:22685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5fc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22685:1874627750257280:0@lo:104: 00000100:00100000:1.0:1787784966.530761:0:22685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787784966.530824:0:22685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951d1628c00/0x88ace7295d9e90f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9e908 expref: 20 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.530832:0:22685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951d1628c00/0x88ace7295d9e90f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9e908 expref: 20 pid: 22663 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784966.530839:0:22685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5da40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22685:1874627750257408:0@lo:104: 00000100:00100000:1.0:1787784966.530860:0:22685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784966.530875:0:22685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d8380180 going to sleep for 11 seconds 00000100:00100000:1.0:1787784966.530898:0:22653:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787784966.530919:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750257280 00000100:00100000:1.0:1787784966.530925:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750257280 00000100:00100000:1.0:1787784966.530959:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750257408 00000100:00100000:1.0:1787784966.530961:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750257408 00000100:00100000:1.0:1787784966.530974:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784966.530981:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+4:22685:x1874627750257280:12345-0@lo:104: 00010000:00010000:1.0:1787784966.530994:0:22653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e91d expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.531038:0:22653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787784966.531044:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+4:22685:x1874627750257280:12345-0@lo:104: Request processed in 64us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784966.531050:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784966.531063:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787784966.531068:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c235fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+3:22685:x1874627750257408:12345-0@lo:104: 00010000:00010000:1.0:1787784966.531075:0:22653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951c0030200/0x88ace7295d9e908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e90f expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.531105:0:22653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787784966.531109:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c235fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+3:22685:x1874627750257408:12345-0@lo:104: Request processed in 41us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784966.531114:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787784966.531147:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784966.531153:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e91d expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.531160:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0031800 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:1.0:1787784966.531164:0:22659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9e91d expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.531182:0:22659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9e91d expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784966.531189:0:22659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9e91d expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784966.531194:0:22659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787784966.531222:0:22659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e916 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e91d expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.531228:0:22659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784966.531329:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e916 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e91d expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.531338:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c0031800/0x88ace7295d9e916 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e91d expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.531351:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784966.531354:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c0030200/0x88ace7295d9e908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e90f expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.531360:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0030200 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:1.0:1787784966.531363:0:22659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c0030200/0x88ace7295d9e908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9e90f expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.531371:0:22659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c0030200/0x88ace7295d9e908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9e90f expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784966.531377:0:22659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c0030200/0x88ace7295d9e908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9e90f expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784966.531453:0:22659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787784966.531468:0:22659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c0030200/0x88ace7295d9e908 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e90f expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.531474:0:22659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784966.531480:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c0030200/0x88ace7295d9e908 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e90f expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.531487:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c0030200/0x88ace7295d9e908 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e90f expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784966.531501:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784966.531503:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784966.531505:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784966.531512:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784966.531533:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e11354d-250d-4393-8e0e-7593eb008ce7:3646:1874627750257536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784966.531841:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784966.531909:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784966.531916:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e11354d-250d-4393-8e0e-7593eb008ce7:3646:1874627750257664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784966.531940:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784966.532064:0:24175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb256580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24175:1874627750257152:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787784966.532079:0:24175:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787784966.532082:0:24175:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787784966.532083:0:24175:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787784966.532085:0:24175:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784966.532086:0:24175:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784966.532087:0:24175:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784966.532088:0:24175:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784966.532089:0:24175:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787784966.532092:0:24175:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784966.532100:0:24175:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787784966.532122:0:24175:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787784966.533549:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750257536 00000100:00100000:2.0:1787784966.533558:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750257536 00010000:00010000:2.0:1787784966.533590:0:22655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951d1629e00/0x88ace7295d9e91d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e916 expref: 21 pid: 22663 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784966.533645:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750257664 00000100:00100000:2.0:1787784966.533649:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750257664 00010000:00010000:2.0:1787784966.533663:0:22655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951d1628c00/0x88ace7295d9e90f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e908 expref: 22 pid: 22663 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784966.533677:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787784966.533684:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+22:3646:x1874627750257536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784966.533696:0:22655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784966.533700:0:22655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951d1629e00/0x88ace7295d9e91d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e916 expref: 22 pid: 22663 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784966.533711:0:22655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951d1629e00/0x88ace7295d9e91d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9e916 expref: 22 pid: 22663 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784966.533739:0:22655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784966.533802:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+22:3646:x1874627750257536:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (1962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784966.533809:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787784966.533824:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787784966.533830:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d2475050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+21:3646:x1874627750257664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784966.533837:0:22655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784966.533841:0:22655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951d1628c00/0x88ace7295d9e90f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e908 expref: 21 pid: 22663 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784966.533849:0:22655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951d1628c00/0x88ace7295d9e90f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9e908 expref: 21 pid: 22663 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784966.533859:0:22655:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8951df603800/0x88ace7295d9e9c5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784966.533874:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df603800/0x88ace7295d9e9c5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787784966.533889:0:22655:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005650253s 00010000:00010000:2.0:1787784966.533894:0:22655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951df603800/0x88ace7295d9e9c5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784966.533901:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951df603800/0x88ace7295d9e9c5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784966.533908:0:22655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8951df603800/0x88ace7295d9e9c5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784966.533914:0:22655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8951df603800/0x88ace7295d9e9c5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784966.533920:0:22655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603800 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784966.533923:0:22655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8951df603800/0x88ace7295d9e9c5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784966.533932:0:22655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8951df603800/0x88ace7295d9e9c5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784966.533941:0:22655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8951df603800/0x88ace7295d9e9c5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784966.533951:0:22655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784966.533974:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d2475050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+21:3646:x1874627750257664:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (2033us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784966.533981:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787784966.534056:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e11354d-250d-4393-8e0e-7593eb008ce7:3646:1874627750257664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784966.534064:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e11354d-250d-4393-8e0e-7593eb008ce7:3646:1874627750257536:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1787784966.535818:0:24175:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:0.0:1787784966.536177:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1629e00/0x88ace7295d9e91d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9e916 expref: 20 pid: 22663 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784966.536199:0:22685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5fc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22685:1874627750257280:0@lo:104: 00010000:00010000:0.0:1787784966.536217:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1628c00/0x88ace7295d9e90f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9e908 expref: 19 pid: 22663 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784966.536228:0:22685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5da40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22685:1874627750257408:0@lo:104: 00010000:00010000:0.0:1787784966.536504:0:22685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8951df603800/0x88ace7295d9e9c5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784966.536518:0:22685:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8951df603800/0x88ace7295d9e9c5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784966.536525:0:22685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8951df603800/0x88ace7295d9e9c5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784966.536532:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df603800/0x88ace7295d9e9c5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787784966.546844:0:24175:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787784966.546856:0:24175:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787784966.546897:0:24175:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787784966.546936:0:24175:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.141@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787784966.546959:0:24175:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787784966.546989:0:24175:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787784966.551527:0:24175:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787784966.551765:0:24175:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787784966.853994:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784967.310966:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb256580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750257792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787784967.311044:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784967.311095:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784967.311102:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750257920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787784967.311124:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784967.311148:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750257792 00000100:00100000:0.0:1787784967.311156:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750257792 00000100:00100000:0.0:1787784967.311204:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750257920 00000100:00100000:0.0:1787784967.311207:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750257920 00000100:00100000:1.0:1787784967.312149:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787784967.312161:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff022940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750257792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787784967.312208:0:23412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787784967.312269:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff022940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750257792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784967.312276:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787784967.312299:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787784967.312306:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff023c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750257920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787784967.312322:0:23412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787784967.312351:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff023c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750257920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784967.312356:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787784967.312415:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750257920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787784967.312428:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb256580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750257792:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1787784967.534930:0:24255:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787784967.535157:0:24255:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787784967.879930:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787784968.330481:0:22705:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1787784968.517905:0:22668:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787784968.517914:0:22668:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8951f81b5800 from 13 10000000:01000000:1.0:1787784968.517920:0:22668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787784968.517967:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df603e00/0x88ace7295d9e9cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784968.517979:0:22668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951df603e00/0x88ace7295d9e9cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784968.517990:0:22668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951df603e00/0x88ace7295d9e9cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784968.518017:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750258048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787784968.518088:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784968.518145:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951efd9d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784968.518300:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750258048 00000100:00100000:3.0:1787784968.518308:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750258048 00000100:00100000:3.0:1787784968.518354:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787784968.518374:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+19:22668:x1874627750258048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784968.518388:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784968.518403:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c151fa00/0x88ace7295d9e9d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e9cc expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784968.518428:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c151fa00/0x88ace7295d9e9d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e9cc expref: 20 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784968.518440:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c151fa00/0x88ace7295d9e9d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e9cc expref: 20 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784968.518459:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c151fa00, rc 0) 00000100:00100000:3.0:1787784968.518515:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+20:22668:x1874627750258048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784968.518523:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787784968.518666:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750258048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784968.518682:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951df603e00/0x88ace7295d9e9cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e9d3 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784968.518692:0:22668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951df603e00/0x88ace7295d9e9cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e9d3 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784968.518760:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750258176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787784968.518978:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784968.519001:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c1254240 going to sleep for 11 seconds 00000100:00100000:1.0:1787784968.519085:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750258176 00000100:00100000:1.0:1787784968.519090:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750258176 00000100:00100000:1.0:1787784968.519120:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787784968.519127:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+20:22668:x1874627750258176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787784968.519141:0:22663:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787784968.519158:0:22663:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787784968.519161:0:22663:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1787784968.519504:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+20:22668:x1874627750258176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 378us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784968.519511:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787784968.519547:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750258176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787784968.519619:0:22668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787784968.519627:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df603e00/0x88ace7295d9e9cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e9d3 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784968.519637:0:22668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951df603e00/0x88ace7295d9e9cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e9d3 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784968.519646:0:22668:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787784968.519649:0:22668:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8951ff20c000 from 13 10000000:01000000:1.0:1787784968.519652:0:22668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787784968.519675:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df602000/0x88ace7295d9e9da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784968.519682:0:22668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951df602000/0x88ace7295d9e9da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784968.519690:0:22668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951df602000/0x88ace7295d9e9da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784968.519723:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750258304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787784968.519750:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784968.519764:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951e0be16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784968.519797:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750258304 00000100:00100000:1.0:1787784968.519801:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750258304 00000100:00100000:1.0:1787784968.519821:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787784968.519825:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+20:22668:x1874627750258304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784968.519832:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784968.519840:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df602e00/0x88ace7295d9e9e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9e9da expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784968.519855:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df602e00/0x88ace7295d9e9e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9e9da expref: 21 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784968.519863:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df602e00/0x88ace7295d9e9e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e9da expref: 21 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784968.519869:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602e00, rc 0) 00000100:00100000:1.0:1787784968.519895:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+21:22668:x1874627750258304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784968.519900:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787784968.519929:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750258304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784968.519940:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951df602000/0x88ace7295d9e9da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e9e1 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784968.519948:0:22668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951df602000/0x88ace7295d9e9da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9e9e1 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784968.519989:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750258432:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787784968.520016:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784968.520028:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951e0be16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784968.520039:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750258432 00000100:00100000:1.0:1787784968.520042:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750258432 00000100:00100000:1.0:1787784968.520061:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787784968.520066:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+21:22668:x1874627750258432:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787784968.520075:0:22663:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787784968.520086:0:22663:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787784968.520088:0:22663:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1787784968.520147:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+21:22668:x1874627750258432:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 80us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784968.520154:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787784968.520180:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750258432:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787784968.520216:0:22668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787784968.520221:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df602000/0x88ace7295d9e9da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e9e1 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784968.520227:0:22668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951df602000/0x88ace7295d9e9da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e9e1 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784968.901898:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784969.925925:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784970.949929:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787784971.915845:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784971.915852:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787784971.915856:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784971.915864:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787784971.915892:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784971.915895:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787784971.915898:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784971.915901:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787784971.915937:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb256940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750258816:0@lo:400:kworker.0 00000100:00100000:0.0:1787784971.916001:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784971.916034:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c32730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750259328:0@lo:400:kworker.0 00000100:00100000:0.0:1787784971.916050:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784971.916070:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784971.916074:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb255e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750258944:0@lo:400:kworker.0 00000100:00100000:0.0:1787784971.916093:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784971.916126:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750258816 00000100:00100000:0.0:1787784971.916133:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750258816 00000100:00100000:0.0:1787784971.916166:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750259328 00000100:00100000:0.0:1787784971.916168:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750259328 00000100:00100000:0.0:1787784971.916190:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787784971.916208:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c32712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750258816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784971.916251:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c32712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750258816:12345-0@lo:400:kworker.0 Request processed in 43us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784971.916257:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787784971.916271:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787784971.916276:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3271a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750259328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784971.916295:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3271a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750259328:12345-0@lo:400:kworker.0 Request processed in 20us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784971.916307:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787784971.916324:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750258944 00000100:00100000:0.0:1787784971.916327:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750258944 00000100:00100000:0.0:1787784971.916344:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787784971.916349:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3271680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750258944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784971.916379:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3271680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750258944:12345-0@lo:400:kworker.0 Request processed in 29us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784971.916385:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787784971.916418:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb255e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750258944:0@lo:400:kworker.0 00010000:00080000:0.0:1787784971.916429:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951fb256940 x1874627750258816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784971.916440:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb256940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750258816:0@lo:400:kworker.0 00010000:00080000:0.0:1787784971.916448:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c32730c0 x1874627750259328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784971.916455:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c32730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750259328:0@lo:400:kworker.0 00000100:00100000:2.0:1787784971.916642:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb256d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e11354d-250d-4393-8e0e-7593eb008ce7:3646:1874627750258560:0@lo:400:kworker.0 00000100:00100000:2.0:1787784971.916694:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784971.916730:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb2561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750259072:0@lo:400:kworker.0 00000100:00100000:2.0:1787784971.916752:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784971.916784:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787784971.916790:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb256580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750258688:0@lo:400:kworker.0 00000100:00100000:2.0:1787784971.916812:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784971.916828:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3271e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750259200:0@lo:400:kworker.0 00000100:00100000:2.0:1787784971.916850:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787784971.916880:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787784971.916900:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750258688 00000100:00100000:2.0:1787784971.916904:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750258688 00000100:00100000:2.0:1787784971.916926:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787784971.916932:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750258688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784971.916967:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750258688:12345-0@lo:400:kworker.0 Request processed in 35us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784971.916973:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787784971.916996:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb256580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750258688:0@lo:400:kworker.0 00000100:00100000:0.0:1787784971.917131:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750258560 00000100:00100000:0.0:1787784971.917136:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750258560 00000100:00100000:0.0:1787784971.917172:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787784971.917179:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+21:3646:x1874627750258560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784971.917227:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+21:3646:x1874627750258560:12345-0@lo:400:kworker.0 Request processed in 49us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784971.917233:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787784971.917266:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb256d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e11354d-250d-4393-8e0e-7593eb008ce7:3646:1874627750258560:0@lo:400:kworker.0 00000100:00100000:0.0:1787784971.917282:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750259072 00000100:00100000:0.0:1787784971.917291:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750259072 00000100:00100000:0.0:1787784971.917313:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750259200 00000100:00100000:0.0:1787784971.917316:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750259200 00000100:00100000:0.0:1787784971.917337:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787784971.917343:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750259072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784971.917377:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750259072:12345-0@lo:400:kworker.0 Request processed in 35us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784971.917383:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787784971.917395:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787784971.917401:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750259200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784971.917427:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874627750259200:12345-0@lo:400:kworker.0 Request processed in 26us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784971.917432:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787784971.917446:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787784971.917466:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8950c3271e00 x1874627750259200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784971.917476:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3271e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1874627750259200:0@lo:400:kworker.0 00010000:00080000:0.0:1787784971.917485:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951fb2561c0 x1874627750259072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784971.917508:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb2561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750259072:0@lo:400:kworker.0 00010000:00010000:1.0:1787784971.978346:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784972.426113:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750259456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784972.426196:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784972.426250:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750259584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787784972.426272:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784972.426311:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750259456 00000100:00100000:1.0:1787784972.426319:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750259456 00000100:00100000:1.0:1787784972.426361:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750259584 00000100:00100000:1.0:1787784972.426364:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750259584 00000100:00100000:1.0:1787784972.426380:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787784972.426389:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750259456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787784972.426423:0:22674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787784972.426467:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750259456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784972.426473:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787784972.426489:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787784972.426495:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750259584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787784972.426511:0:22674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787784972.426537:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750259584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 43us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784972.426544:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787784972.426583:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750259584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787784972.426613:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750259456:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787784973.005094:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787784973.383328:0:23428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1787784973.502317:0:24545:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787784974.025631:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787784974.588752:0:24597:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787784974.588985:0:24597:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787784975.047125:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787784975.818633:0:24648:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787784975.819177:0:24648:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787784976.070976:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784976.775221:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784961/real 1787784961] req@ffff8951fd7c1680 x1874627750253056/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784976 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784976.775280:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8951fd7c1680 x1874627750253056/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784976 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784976.775291:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784961/real 1787784961] req@ffff8951fd7c0780 x1874627750253184/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784976 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784976.775301:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8951fd7c0780 x1874627750253184/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784976 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787784976.775321:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951fa9c5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784976.775345:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787784976.775349:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750253056:0@lo:8:kworker.0 00000100:00080000:1.0:1787784976.775355:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c259a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784976.775359:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787784976.775362:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750253184:0@lo:8:kworker.0 00000100:00080000:1.0:1787784976.775460:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784976.775465:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784976.775468:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784976.775471:0:15021:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784976.775487:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784976.775490:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787784976.775492:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8951fa9c5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787784976.775497:0:15021:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 701 00000100:00080000:1.0:1787784976.775502:0:15021:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787784976.775528:0:15021:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8951fa9c5800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784976.775549:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951d1b5fc00 x1874627750260224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787784976.775563:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784976.775565:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787784976.775567:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8950c259a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787784976.775570:0:15021:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 701 00000100:00080000:1.0:1787784976.775572:0:15021:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787784976.775575:0:15021:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8950c259a000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784976.775583:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951d1b5f840 x1874627750260352/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787784976.775625:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e11354d-250d-4393-8e0e-7593eb008ce7:3647:1874627750259712:0@lo:400:kworker.0 00000100:00100000:1.0:1787784976.775700:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784976.775747:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750260480:0@lo:400:kworker.0 00000100:00100000:1.0:1787784976.775793:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784976.775818:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787784976.775824:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750260096:0@lo:400:kworker.0 00000100:00100000:1.0:1787784976.775849:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784976.775877:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750259840:0@lo:400:kworker.0 00000100:00100000:1.0:1787784976.775902:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784976.775918:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750260608:0@lo:400:kworker.0 00000100:00100000:1.0:1787784976.775942:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784976.775960:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787784976.775965:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750259968:0@lo:400:kworker.0 00000100:00100000:1.0:1787784976.775997:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784976.776015:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750260736:0@lo:400:kworker.0 00000100:00100000:1.0:1787784976.776039:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784976.776066:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750259712 00000100:00100000:1.0:1787784976.776073:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750259712 00000100:00100000:1.0:1787784976.776119:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787784976.776128:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+21:3647:x1874627750259712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784976.776176:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+21:3647:x1874627750259712:12345-0@lo:400:kworker.0 Request processed in 48us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784976.776183:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787784976.776217:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750260480 00000100:00100000:1.0:1787784976.776221:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750260480 00000100:00100000:1.0:1787784976.776240:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750260608 00000100:00100000:1.0:1787784976.776242:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750260608 00000100:00100000:1.0:1787784976.776268:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750259968 00000100:00100000:1.0:1787784976.776271:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750259968 00000100:00100000:1.0:1787784976.776281:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750260736 00000100:00100000:1.0:1787784976.776283:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750260736 00000100:00100000:1.0:1787784976.776299:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787784976.776305:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750260480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784976.776338:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750260480:12345-0@lo:400:kworker.0 Request processed in 34us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784976.776344:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787784976.776357:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787784976.776364:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750260608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784976.776407:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750260608:12345-0@lo:400:kworker.0 Request processed in 43us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784976.776424:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787784976.776436:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787784976.776443:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750259968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784976.776472:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750259968:12345-0@lo:400:kworker.0 Request processed in 30us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784976.776478:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787784976.776489:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787784976.776496:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750260736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784976.776522:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750260736:12345-0@lo:400:kworker.0 Request processed in 27us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784976.776527:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787784976.776547:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750260096 00000100:00100000:1.0:1787784976.776550:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750260096 00000100:00100000:1.0:1787784976.776570:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750259840 00000100:00100000:1.0:1787784976.776573:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750259840 00000100:00100000:1.0:1787784976.776583:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787784976.776589:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750260096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784976.776619:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750260096:12345-0@lo:400:kworker.0 Request processed in 30us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784976.776625:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787784976.776649:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787784976.776655:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750259840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784976.776685:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750259840:12345-0@lo:400:kworker.0 Request processed in 31us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784976.776691:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787784976.776731:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787784976.776736:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787784976.776764:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951d1b5c3c0 x1874627750259968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784976.776802:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750259968:0@lo:400:kworker.0 00010000:00080000:1.0:1787784976.776814:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951d1b5e1c0 x1874627750260736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784976.776822:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750260736:0@lo:400:kworker.0 00000100:00100000:1.0:1787784976.776832:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750259840:0@lo:400:kworker.0 00010000:00080000:1.0:1787784976.776840:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951d1b5f0c0 x1874627750260608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784976.776848:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750260608:0@lo:400:kworker.0 00000100:00100000:1.0:1787784976.776877:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750260224:0@lo:8:kworker.0 00000100:00100000:1.0:1787784976.776906:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784976.776935:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750260352:0@lo:8:kworker.0 00000100:00100000:1.0:1787784976.776970:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784976.777004:0:24181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750260224 00000100:00100000:1.0:1787784976.777007:0:24181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750260224 00000100:00100000:1.0:1787784976.777023:0:24181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750260352 00000100:00100000:1.0:1787784976.777025:0:24181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750260352 00000100:00100000:1.0:1787784976.777034:0:24181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784976.777038:0:24181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1874627750260224:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787784976.777064:0:24181:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 717 last 0 00000020:00000080:1.0:1787784976.777091:0:24181:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x88ace7295d9e9e8 00002000:00100000:1.0:1787784976.777105:0:24181:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8950c2598000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113936 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1787784976.777114:0:24181:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1787784976.777117:0:24181:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787784976.777314:0:24181:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1787784976.777338:0:24181:0:(import.c:65:import_set_state_nolock()) ffff8950c259b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784976.777377:0:24181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1874627750260224:12345-0@lo:8:kworker.0 Request processed in 338us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784976.777384:0:24181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784976.777396:0:24181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784976.777400:0:24181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1874627750260352:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787784976.777412:0:24181:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787784976.779889:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750260096:0@lo:400:kworker.0 00000100:00100000:3.0:1787784976.779906:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e11354d-250d-4393-8e0e-7593eb008ce7:3647:1874627750259712:0@lo:400:kworker.0 00010000:00080000:3.0:1787784976.779920:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951d1b5e580 x1874627750260480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784976.779929:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750260480:0@lo:400:kworker.0 00010000:00080000:0.0:1787784976.782948:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951d1b5fc00 x1874627750260224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787784996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784976.782968:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787784976.782986:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1787784976.783010:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787784976.783018:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787784976.783022:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951fa9c5800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787784976.783091:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787784976.783100:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750260224:0@lo:8:kworker.0 00000004:00080000:3.0:1787784976.796659:0:23415:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787784976.796693:0:23415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff021a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23415:1874627750260992:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1787784976.796786:0:23415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784976.796820:0:23415:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95b540 going to sleep for 11 seconds 00000004:00080000:3.0:1787784976.796844:0:23414:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787784976.796943:0:23414:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 717046174176ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787784976.796950:0:23414:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787784976.797141:0:24179:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787784976.797149:0:24179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787784976.797165:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784976.797178:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff020000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750260864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784976.797211:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784976.797839:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750260864 00000100:00100000:0.0:1787784976.797849:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750260864 00000100:00100000:0.0:1787784976.797912:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784976.797922:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff023480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874627750260864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787784976.797956:0:24183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787784976.798021:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff023480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874627750260864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784976.798028:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787784976.799427:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787784976.799494:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951ff020000 x1874627750260864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784976.799532:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff020000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750260864:0@lo:13:osp-pre-0-1.0 00000004:00080000:3.0:1787784976.806746:0:23404:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1787784976.812176:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750260992 00000100:00100000:0.0:1787784976.812188:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750260992 00000100:00100000:3.0:1787784976.812360:0:24684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787784976.812373:0:24684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff020780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23415:x1874627750260992:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1787784976.832259:0:24181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1874627750260352:12345-0@lo:8:kworker.0 Request processed in 54852us (55283us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787784976.832274:0:24181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787784976.833482:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c259a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787784976.833493:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787784976.833499:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750260352:0@lo:8:kworker.0 00002000:00080000:1.0:1787784976.836658:0:24684:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1787784976.836669:0:24684:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1787784976.836869:0:24684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff020780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23415:x1874627750260992:12345-0@lo:7:osp-pre-0-1.0 Request processed in 24488us (40073us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784976.836885:0:24684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787784976.846025:0:23415:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951ff021a40 x1874627750260992/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787784992 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784976.846044:0:23415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff021a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23415:1874627750260992:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1787784976.846058:0:23415:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:2.0:1787784976.846180:0:23415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23415:1874627750261120:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787784976.846250:0:23415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784976.846305:0:23415:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fbd6e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784976.849430:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750261120 00000100:00100000:3.0:1787784976.849447:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750261120 00000100:00100000:3.0:1787784976.849515:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787784976.849525:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23415:x1874627750261120:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787784976.849559:0:24179:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1787784976.849664:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23415:x1874627750261120:12345-0@lo:5:osp-pre-0-1.0 Request processed in 140us (3412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784976.849671:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787784976.849717:0:23415:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951cffcad00 x1874627750261120/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787784992 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784976.849731:0:23415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23415:1874627750261120:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787784976.849743:0:23415:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1787784976.849800:0:23415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff021a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23415:1874627750261248:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787784976.849833:0:23415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784976.849871:0:24181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750261248 00000100:00100000:3.0:1787784976.849874:0:24181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750261248 00000100:00100000:3.0:1787784976.849906:0:24181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787784976.849912:0:24181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff020000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23415:x1874627750261248:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787784976.849939:0:24181:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:3.0:1787784976.850103:0:23415:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95b540 going to sleep for 11 seconds 00000001:00080000:2.0:1787784976.893571:0:24176:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1787784976.893590:0:24176:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787784976.895247:0:24181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff020000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23415:x1874627750261248:12345-0@lo:5:osp-pre-0-1.0 Request processed in 45326us (45404us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1787784976.895264:0:24181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787784976.896460:0:23415:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951ff021a40 x1874627750261248/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787784992 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784976.896474:0:23415:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1787784976.896481:0:23415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff021a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23415:1874627750261248:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787784976.896495:0:23415:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:2.0:1787784976.896547:0:23415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23415:1874627750261376:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787784976.896590:0:23415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784976.896614:0:23415:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fbd6e900 going to sleep for 11 seconds 00000100:00100000:0.0:1787784976.897509:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750261376 00000100:00100000:0.0:1787784976.897517:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750261376 00000100:00100000:0.0:1787784976.897569:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784976.897579:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23415:x1874627750261376:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787784976.897657:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23415:x1874627750261376:12345-0@lo:900:osp-pre-0-1.0 Request processed in 80us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784976.897678:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787784976.897755:0:23415:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951cffc8f00 x1874627750261376/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787784992 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784976.897809:0:23415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23415:1874627750261376:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1787784977.095422:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784977.548705:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951efef2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750261504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784977.548790:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784977.548845:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951efef1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750261632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787784977.548863:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784977.548887:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750261504 00000100:00100000:1.0:1787784977.548892:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750261504 00000100:00100000:1.0:1787784977.548927:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750261632 00000100:00100000:1.0:1787784977.548928:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750261632 00000100:00100000:1.0:1787784977.548939:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787784977.548959:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750261504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787784977.548989:0:22674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787784977.549025:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750261504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784977.549030:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787784977.549044:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787784977.549048:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750261632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787784977.549059:0:22674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787784977.549076:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750261632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 28us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784977.549079:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787784977.549111:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951efef1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750261632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787784977.549128:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951efef2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750261504:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787784978.123297:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787784978.567948:0:22705:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787784979.144881:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784980.173685:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784981.191799:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784981.893959:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784961/real 1787784961] req@ffff8951fbe59e00 x1874627750253440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784981 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784981.893993:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8951fbe59e00 x1874627750253440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784981 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784981.894003:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784961/real 1787784961] req@ffff8951fbe58b40 x1874627750253568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784981 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784981.894015:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8951fbe58b40 x1874627750253568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784981 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787784981.894032:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c41fa800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784981.894048:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787784981.894052:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750253440:0@lo:8:kworker.0 00000100:00080000:2.0:1787784981.894058:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951f67dc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784981.894062:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787784981.894065:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750253568:0@lo:8:kworker.0 00000100:00080000:3.0:1787784981.894162:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787784981.894168:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787784981.894170:0:37:0:(import.c:65:import_set_state_nolock()) ffff8950c41fa800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787784981.894175:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 701 00000100:00080000:3.0:1787784981.894180:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787784981.894187:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8950c41fa800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1787784981.894206:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951ff021e00 x1874627750262016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787784981.894217:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787784981.894220:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787784981.894222:0:37:0:(import.c:65:import_set_state_nolock()) ffff8951f67dc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787784981.894225:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 701 00000100:00080000:3.0:1787784981.894228:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787784981.894231:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8951f67dc000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1787784981.894252:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951ff0212c0 x1874627750262144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787784981.894280:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787784981.894283:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787784981.894285:0:37:0:(import.c:65:import_set_state_nolock()) ffff8950c259a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787784981.894304:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 717 00000100:00080000:3.0:1787784981.894306:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787784981.894310:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8950c259a000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1787784981.894322:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951fd7c1680 x1874627750262656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787784981.894371:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff021a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750261888:0@lo:400:kworker.0 00000100:00100000:1.0:1787784981.894430:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e11354d-250d-4393-8e0e-7593eb008ce7:3645:1874627750261760:0@lo:400:kworker.0 00000100:00100000:0.0:1787784981.894437:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784981.894495:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750262400:0@lo:400:kworker.0 00000100:00100000:3.0:1787784981.894497:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750261888 00000100:00100000:3.0:1787784981.894504:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750261888 00000100:00100000:3.0:1787784981.894550:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787784981.894558:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c32703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750261888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784981.894882:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784981.894925:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750262528:0@lo:400:kworker.0 00000100:00100000:1.0:1787784981.894949:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784981.894981:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750262272:0@lo:400:kworker.0 00000100:00100000:1.0:1787784981.895005:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784981.895020:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750262912:0@lo:400:kworker.0 00000100:00100000:1.0:1787784981.895037:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784981.895064:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750261760 00000100:00100000:1.0:1787784981.895067:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750261760 00000100:00100000:1.0:1787784981.895105:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787784981.895110:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+21:3645:x1874627750261760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784981.895145:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+21:3645:x1874627750261760:12345-0@lo:400:kworker.0 Request processed in 34us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784981.895151:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787784981.895180:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750262528 00000100:00100000:1.0:1787784981.895182:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750262528 00000100:00100000:1.0:1787784981.895214:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784981.895219:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750262528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784981.895258:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750262528:12345-0@lo:400:kworker.0 Request processed in 38us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784981.895264:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784981.895282:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750262272 00000100:00100000:1.0:1787784981.895285:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750262272 00000100:00100000:1.0:1787784981.895307:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750262912 00000100:00100000:1.0:1787784981.895310:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750262912 00000100:00100000:1.0:1787784981.895325:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787784981.895331:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750262272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784981.895485:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750262272:12345-0@lo:400:kworker.0 Request processed in 153us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784981.895491:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787784981.895503:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787784981.895519:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750262912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784981.895549:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750262912:12345-0@lo:400:kworker.0 Request processed in 41us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784981.895555:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787784981.895578:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784981.895606:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787784981.895639:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951ff0221c0 x1874627750262272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784981.895652:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750262272:0@lo:400:kworker.0 00010000:00080000:1.0:1787784981.895662:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951fd7c2d00 x1874627750262912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784981.895669:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750262912:0@lo:400:kworker.0 00000100:00100000:1.0:1787784981.895695:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e11354d-250d-4393-8e0e-7593eb008ce7:3645:1874627750261760:0@lo:400:kworker.0 00010000:00080000:1.0:1787784981.895704:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951fd7c0780 x1874627750262528/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784981.895712:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750262528:0@lo:400:kworker.0 00000100:00100000:0.0:1787784981.896833:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750262784:0@lo:400:kworker.0 00000100:00100000:0.0:1787784981.896875:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784981.896968:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750262784 00000100:00100000:1.0:1787784981.896975:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750262784 00000100:00100000:1.0:1787784981.897021:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787784981.897029:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750262784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784981.897076:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750262784:12345-0@lo:400:kworker.0 Request processed in 48us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784981.897083:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787784981.897116:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951fd7c30c0 x1874627750262784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784981.897129:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750262784:0@lo:400:kworker.0 00000100:00100000:2.0:1787784981.897561:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784981.897604:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750263040:0@lo:400:kworker.0 00000100:00100000:3.0:1787784981.897611:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c32703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750261888:12345-0@lo:400:kworker.0 Request processed in 3053us (3173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784981.897620:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787784981.897634:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784981.897636:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750262400 00000100:00100000:3.0:1787784981.897640:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750262400 00000100:00100000:3.0:1787784981.897658:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787784981.897664:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750262400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784981.897691:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff021e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750262016:0@lo:8:kworker.0 00000100:00100000:3.0:1787784981.897700:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750262400:12345-0@lo:400:kworker.0 Request processed in 36us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784981.897705:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787784981.897716:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784981.897742:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750262144:0@lo:8:kworker.0 00000100:00100000:2.0:1787784981.897761:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784981.897800:0:24181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750262016 00000100:00100000:2.0:1787784981.897800:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750262656:0@lo:8:kworker.0 00000100:00100000:3.0:1787784981.897804:0:24181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750262016 00000100:00100000:3.0:1787784981.897819:0:24181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750262144 00000100:00100000:3.0:1787784981.897822:0:24181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750262144 00000100:00100000:2.0:1787784981.897825:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784981.897881:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750263040 00000100:00100000:1.0:1787784981.897884:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750263040 00000100:00100000:1.0:1787784981.897964:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787784981.897975:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750263040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784981.898003:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750263040:12345-0@lo:400:kworker.0 Request processed in 29us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784981.898008:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787784981.898046:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787784981.899577:0:24684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750262656 00000100:00100000:3.0:1787784981.899608:0:24181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787784981.899617:0:24181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1874627750262016:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787784981.899651:0:24181:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 722 last 0 00000020:00000080:3.0:1787784981.899678:0:24181:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88ace7295d9e9ef 00002000:00100000:3.0:1787784981.899702:0:24181:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8951c4560800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113936 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787784981.899706:0:24181:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787784981.899709:0:24181:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787784981.899796:0:24181:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787784981.899821:0:24181:0:(import.c:65:import_set_state_nolock()) ffff8951c4562800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787784981.899885:0:24181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1874627750262016:12345-0@lo:8:kworker.0 Request processed in 267us (2166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784981.899893:0:24181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787784981.899909:0:24181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787784981.899913:0:24181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1874627750262144:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787784981.899925:0:24181:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787784981.899948:0:24181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1874627750262144:12345-0@lo:8:kworker.0 Request processed in 34us (2185us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787784981.899954:0:24181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787784981.900660:0:24684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750262656 00000100:00100000:2.0:1787784981.900701:0:24684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787784981.900709:0:24684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3643:x1874627750262656:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787784981.900721:0:24684:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787784981.900755:0:24684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3643:x1874627750262656:12345-0@lo:8:kworker.0 Request processed in 48us (2929us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787784981.900762:0:24684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787784981.900821:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750262400:0@lo:400:kworker.0 00010000:00080000:2.0:1787784981.900837:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951fd7c3c00 x1874627750263040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784981.900848:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750263040:0@lo:400:kworker.0 00010000:00080000:2.0:1787784981.900879:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951ff021e00 x1874627750262016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787785006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784981.900887:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787784981.900894:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787784981.900901:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787784981.900907:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787784981.900910:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c41fa800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787784981.900936:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787784981.900942:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff021e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750262016:0@lo:8:kworker.0 00000100:00080000:2.0:1787784981.900954:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951f67dc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784981.900958:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787784981.900961:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750262144:0@lo:8:kworker.0 00000100:00080000:2.0:1787784981.900969:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c259a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784981.900972:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787784981.900975:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750262656:0@lo:8:kworker.0 00000004:00080000:2.0:1787784981.901031:0:22694:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1787784981.901051:0:22694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc9680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22694:1874627750263296:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787784981.901084:0:22694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784981.901102:0:22694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3685f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784981.901111:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784981.901118:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffcad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750263168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784981.901139:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784981.901169:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750263168 00000100:00100000:2.0:1787784981.901173:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750263168 00000100:00100000:2.0:1787784981.901209:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784981.901215:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750263168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787784981.901236:0:24183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787784981.901286:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1874627750263168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784981.901292:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787784981.901310:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787784981.901327:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951cffcad00 x1874627750263168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784981.901361:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffcad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750263168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784981.901455:0:24684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750263296 00000100:00100000:2.0:1787784981.901459:0:24684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750263296 00000100:00100000:2.0:1787784981.901476:0:24684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787784981.901482:0:24684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22694:x1874627750263296:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787784981.901842:0:22693:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787784981.901917:0:22693:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 722151148100ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787784981.901923:0:22693:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1787784981.902894:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff021a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750261888:0@lo:400:kworker.0 00000004:00080000:1.0:1787784981.907503:0:22650:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1787784981.911101:0:24684:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1787784981.911116:0:24684:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:3.0:1787784981.911122:0:24684:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00002000:00010000:3.0:1787784981.917889:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784981.917901:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068d510bd/0x88ace7295d9e9f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.917917:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1787784981.917922:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784981.917929:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068d510bd/0x88ace7295d9e9f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.917946:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068d510bd/0x88ace7295d9e9f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.917965:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068d510bd/0x88ace7295d9e9f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.917973:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068d510bd/0x88ace7295d9e9f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.918048:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784981.918904:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784981.918912:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045419dd9/0x88ace7295d9e9fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.918926:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1787784981.918930:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784981.918935:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045419dd9/0x88ace7295d9e9fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.918947:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045419dd9/0x88ace7295d9e9fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.918956:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045419dd9/0x88ace7295d9e9fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.918964:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045419dd9/0x88ace7295d9e9fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.919042:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784981.919051:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068d510bd/0x88ace7295d9e9f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.919059:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151f600 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784981.919064:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068d510bd/0x88ace7295d9e9f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.919072:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068d510bd/0x88ace7295d9e9f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.919089:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068d510bd/0x88ace7295d9e9f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.919097:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068d510bd/0x88ace7295d9e9f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.919117:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784981.919120:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045419dd9/0x88ace7295d9e9fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.919125:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151e000 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784981.919134:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045419dd9/0x88ace7295d9e9fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.919142:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045419dd9/0x88ace7295d9e9fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.919151:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045419dd9/0x88ace7295d9e9fd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.919159:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.919160:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.919162:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784981.919200:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787784981.919205:0:24684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045419dd9/0x88ace7295d9e9fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784981.919628:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784981.919895:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784981.919902:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a632fa5/0x88ace7295d9ea04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.919913:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1787784981.919916:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784981.919921:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a632fa5/0x88ace7295d9ea04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.919930:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a632fa5/0x88ace7295d9ea04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.919938:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a632fa5/0x88ace7295d9ea04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.919946:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a632fa5/0x88ace7295d9ea04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.919970:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784981.920008:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784981.920017:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a632fa5/0x88ace7295d9ea04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784981.920027:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151f200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784981.920031:0:23827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a632fa5/0x88ace7295d9ea04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784981.920040:0:23827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a632fa5/0x88ace7295d9ea04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784981.920056:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a632fa5/0x88ace7295d9ea04 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784981.920063:0:23827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a632fa5/0x88ace7295d9ea04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784981.920079:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784981.920081:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784981.920088:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784981.920205:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784981.920211:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da9e12c/0x88ace7295d9ea0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.920226:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1787784981.920230:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784981.920234:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009da9e12c/0x88ace7295d9ea0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.920300:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009da9e12c/0x88ace7295d9ea0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.920309:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da9e12c/0x88ace7295d9ea0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.920317:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009da9e12c/0x88ace7295d9ea0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.920464:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784981.921026:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784981.921032:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ea12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.921042:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1787784981.921046:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784981.921050:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ea12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.921059:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ea12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.921080:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ea12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.921087:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ea12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.921133:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784981.921141:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009da9e12c/0x88ace7295d9ea0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.921148:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151e200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784981.921152:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009da9e12c/0x88ace7295d9ea0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.921160:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009da9e12c/0x88ace7295d9ea0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.921172:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009da9e12c/0x88ace7295d9ea0b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.921178:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009da9e12c/0x88ace7295d9ea0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.921201:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784981.921204:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ea12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.921210:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713400 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784981.921213:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ea12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.921219:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ea12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.921229:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ea12 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.921236:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.921238:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.921240:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784981.921326:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787784981.921479:0:24684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ea12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784981.921624:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784981.921935:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784981.921942:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4c987b7/0x88ace7295d9ea19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.921952:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1787784981.921956:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784981.921961:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4c987b7/0x88ace7295d9ea19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.921971:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4c987b7/0x88ace7295d9ea19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.921978:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4c987b7/0x88ace7295d9ea19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.921996:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4c987b7/0x88ace7295d9ea19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.922017:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784981.922314:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784981.922320:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a33132f/0x88ace7295d9ea20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.922329:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1787784981.922499:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784981.922504:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a33132f/0x88ace7295d9ea20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.922514:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a33132f/0x88ace7295d9ea20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.922522:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a33132f/0x88ace7295d9ea20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.922529:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a33132f/0x88ace7295d9ea20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.922586:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787784981.922895:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784981.922901:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000113fc6c5/0x88ace7295d9ea27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.922916:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1787784981.922918:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784981.922923:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000113fc6c5/0x88ace7295d9ea27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.922931:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000113fc6c5/0x88ace7295d9ea27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.922939:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000113fc6c5/0x88ace7295d9ea27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.922947:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000113fc6c5/0x88ace7295d9ea27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.922996:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787784981.923003:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4c987b7/0x88ace7295d9ea19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.923010:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713000 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784981.923014:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4c987b7/0x88ace7295d9ea19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.923034:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4c987b7/0x88ace7295d9ea19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.923048:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4c987b7/0x88ace7295d9ea19 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.923056:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4c987b7/0x88ace7295d9ea19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.923074:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784981.923077:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a33132f/0x88ace7295d9ea20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.923084:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784981.923087:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a33132f/0x88ace7295d9ea20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.923094:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a33132f/0x88ace7295d9ea20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.923104:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a33132f/0x88ace7295d9ea20 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.923112:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a33132f/0x88ace7295d9ea20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.923136:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784981.923140:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000113fc6c5/0x88ace7295d9ea27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.923146:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784981.923149:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000113fc6c5/0x88ace7295d9ea27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.923156:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000113fc6c5/0x88ace7295d9ea27 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.923167:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000113fc6c5/0x88ace7295d9ea27 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.923174:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.923176:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.923178:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784981.923612:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784981.923831:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787784981.923838:0:24684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000113fc6c5/0x88ace7295d9ea27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787784981.924298:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784981.924306:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a43e4949/0x88ace7295d9ea2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.924318:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1787784981.924322:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784981.924328:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a43e4949/0x88ace7295d9ea2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.924696:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a43e4949/0x88ace7295d9ea2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.924706:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a43e4949/0x88ace7295d9ea2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.924713:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a43e4949/0x88ace7295d9ea2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.924802:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784981.924808:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a43e4949/0x88ace7295d9ea2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.924817:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713c00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:0.0:1787784981.924822:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a43e4949/0x88ace7295d9ea2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.924830:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a43e4949/0x88ace7295d9ea2e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.924846:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a43e4949/0x88ace7295d9ea2e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.924854:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784981.924863:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784981.924865:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784981.925221:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787784981.925227:0:24684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a43e4949/0x88ace7295d9ea2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787784981.926302:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784981.926316:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bb3ba76/0x88ace7295d9ea35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.926348:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1787784981.929151:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784981.929163:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bb3ba76/0x88ace7295d9ea35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.929182:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bb3ba76/0x88ace7295d9ea35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.929213:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bb3ba76/0x88ace7295d9ea35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.929220:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bb3ba76/0x88ace7295d9ea35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.931565:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784981.931580:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bb3ba76/0x88ace7295d9ea35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.931605:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712e00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784981.931610:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bb3ba76/0x88ace7295d9ea35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.931642:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bb3ba76/0x88ace7295d9ea35 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.931663:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bb3ba76/0x88ace7295d9ea35 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.931674:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.931675:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.931678:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784981.931889:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787784981.931897:0:24684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bb3ba76/0x88ace7295d9ea35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787784981.932630:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784981.932638:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ea3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.932652:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1787784981.932657:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784981.932664:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ea3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.932676:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ea3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.932687:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ea3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.932705:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ea3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.932744:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784981.932751:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ea3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.932758:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:0.0:1787784981.932761:0:23827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ea3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.932814:0:23827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ea3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.932826:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ea3c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.932835:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784981.932837:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784981.932838:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784981.934615:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787784981.934629:0:24684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ea3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784981.935033:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784981.936019:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784981.936032:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a43e4949/0x88ace7295d9ea43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.936050:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1787784981.936055:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784981.936061:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a43e4949/0x88ace7295d9ea43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.936076:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a43e4949/0x88ace7295d9ea43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.936088:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a43e4949/0x88ace7295d9ea43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.936097:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a43e4949/0x88ace7295d9ea43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.936141:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784981.936686:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784981.936693:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000113fc6c5/0x88ace7295d9ea4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.936703:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1787784981.936706:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784981.936710:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000113fc6c5/0x88ace7295d9ea4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.936718:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000113fc6c5/0x88ace7295d9ea4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.936726:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000113fc6c5/0x88ace7295d9ea4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.936733:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000113fc6c5/0x88ace7295d9ea4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.936847:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787784981.938696:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784981.938711:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a43e4949/0x88ace7295d9ea43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784981.938725:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713c00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784981.938730:0:23827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a43e4949/0x88ace7295d9ea43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784981.938741:0:23827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a43e4949/0x88ace7295d9ea43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784981.938763:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a43e4949/0x88ace7295d9ea43 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784981.938786:0:23827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a43e4949/0x88ace7295d9ea43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784981.938810:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784981.938815:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000113fc6c5/0x88ace7295d9ea4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784981.938822:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784981.938825:0:23827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000113fc6c5/0x88ace7295d9ea4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784981.938848:0:23827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000113fc6c5/0x88ace7295d9ea4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784981.938859:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000113fc6c5/0x88ace7295d9ea4a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784981.938867:0:23827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000113fc6c5/0x88ace7295d9ea4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784981.938881:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784981.938883:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784981.938884:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784981.939149:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784981.939159:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ea51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.939172:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1787784981.939182:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784981.939190:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ea51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.939203:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ea51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.939213:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ea51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.939222:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ea51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.939252:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784981.940790:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784981.940804:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ea51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784981.940817:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713400 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784981.940821:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ea51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784981.940831:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ea51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784981.940849:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ea51 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784981.940871:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ea51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784981.940890:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784981.940892:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784981.940894:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784981.941262:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784981.941271:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c4b4de5/0x88ace7295d9ea58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.941284:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1787784981.941289:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784981.941296:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c4b4de5/0x88ace7295d9ea58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.941321:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c4b4de5/0x88ace7295d9ea58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.941501:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c4b4de5/0x88ace7295d9ea58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.941511:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c4b4de5/0x88ace7295d9ea58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.941535:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784981.941922:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784981.941931:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c4b4de5/0x88ace7295d9ea58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.941940:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d35000 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784981.941944:0:23827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c4b4de5/0x88ace7295d9ea58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.941952:0:23827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c4b4de5/0x88ace7295d9ea58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.941966:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c4b4de5/0x88ace7295d9ea58 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.941985:0:23827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c4b4de5/0x88ace7295d9ea58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.942004:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784981.942006:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784981.942008:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784981.942551:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784981.942560:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c6ba4cd/0x88ace7295d9ea5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.942571:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1787784981.942575:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784981.942580:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c6ba4cd/0x88ace7295d9ea5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.942600:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c6ba4cd/0x88ace7295d9ea5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.942609:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c6ba4cd/0x88ace7295d9ea5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.942630:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c6ba4cd/0x88ace7295d9ea5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.942655:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784981.943360:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784981.943367:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c6ba4cd/0x88ace7295d9ea5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.943378:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d35a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784981.943383:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c6ba4cd/0x88ace7295d9ea5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.943391:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c6ba4cd/0x88ace7295d9ea5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.943406:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c6ba4cd/0x88ace7295d9ea5f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.943414:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c6ba4cd/0x88ace7295d9ea5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.943433:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784981.943434:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784981.943436:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.944457:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784981.944608:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784981.944617:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019cc38b3/0x88ace7295d9ea66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.944633:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1787784981.944637:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784981.944644:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019cc38b3/0x88ace7295d9ea66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.944656:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019cc38b3/0x88ace7295d9ea66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.944665:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019cc38b3/0x88ace7295d9ea66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.944673:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019cc38b3/0x88ace7295d9ea66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.944699:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787784981.945160:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784981.945167:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019cc38b3/0x88ace7295d9ea66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.945176:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d34a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784981.945181:0:23827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019cc38b3/0x88ace7295d9ea66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.945190:0:23827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019cc38b3/0x88ace7295d9ea66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.945205:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019cc38b3/0x88ace7295d9ea66 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.945213:0:23827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019cc38b3/0x88ace7295d9ea66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.945257:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.945259:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.945261:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784981.946653:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784981.946666:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3dbfc5d/0x88ace7295d9ea6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.946692:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1787784981.946696:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784981.946703:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3dbfc5d/0x88ace7295d9ea6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.946715:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3dbfc5d/0x88ace7295d9ea6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.946725:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3dbfc5d/0x88ace7295d9ea6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.946733:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3dbfc5d/0x88ace7295d9ea6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.946761:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784981.947464:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784981.947473:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3dbfc5d/0x88ace7295d9ea6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.947484:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d34800 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784981.947488:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3dbfc5d/0x88ace7295d9ea6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.947498:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3dbfc5d/0x88ace7295d9ea6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.947514:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3dbfc5d/0x88ace7295d9ea6d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.947522:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3dbfc5d/0x88ace7295d9ea6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.947541:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784981.947543:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784981.947545:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784981.949565:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784981.949580:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9ea74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.949605:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1787784981.949609:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784981.949615:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9ea74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.949629:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9ea74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.949657:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9ea74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.949664:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9ea74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.949681:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787784981.953414:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784981.953430:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9ea74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.953445:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d35600 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784981.953450:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9ea74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.953462:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9ea74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.953482:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9ea74 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.953489:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9ea74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.953511:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.953513:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.953515:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784981.953815:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784981.953825:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000142acb7b/0x88ace7295d9ea7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.953838:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1787784981.953843:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784981.953849:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000142acb7b/0x88ace7295d9ea7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.953861:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000142acb7b/0x88ace7295d9ea7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.953872:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000142acb7b/0x88ace7295d9ea7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.953880:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000142acb7b/0x88ace7295d9ea7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.953921:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787784981.954625:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784981.954634:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000142acb7b/0x88ace7295d9ea7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.954657:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d34600 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784981.954662:0:23827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000142acb7b/0x88ace7295d9ea7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.954673:0:23827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000142acb7b/0x88ace7295d9ea7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.954688:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000142acb7b/0x88ace7295d9ea7b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.954695:0:23827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000142acb7b/0x88ace7295d9ea7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.954717:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.954718:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.954720:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784981.955955:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784981.955967:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d73ca1c/0x88ace7295d9ea82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.955982:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1787784981.955987:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784981.955993:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d73ca1c/0x88ace7295d9ea82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.956006:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d73ca1c/0x88ace7295d9ea82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.956016:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d73ca1c/0x88ace7295d9ea82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.956972:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d73ca1c/0x88ace7295d9ea82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.957005:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787784981.957019:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784981.957025:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d73ca1c/0x88ace7295d9ea82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.957033:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d34200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:0.0:1787784981.957048:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d73ca1c/0x88ace7295d9ea82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.957057:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d73ca1c/0x88ace7295d9ea82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.957074:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d73ca1c/0x88ace7295d9ea82 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.957082:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d73ca1c/0x88ace7295d9ea82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.957105:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784981.957106:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784981.957108:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784981.959906:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784981.959922:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c6ba4cd/0x88ace7295d9ea89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.959941:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1787784981.959946:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784981.959952:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c6ba4cd/0x88ace7295d9ea89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.959967:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c6ba4cd/0x88ace7295d9ea89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.959978:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c6ba4cd/0x88ace7295d9ea89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.959999:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c6ba4cd/0x88ace7295d9ea89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.960020:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787784981.961101:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784981.961111:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c4b4de5/0x88ace7295d9ea90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.961122:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1787784981.961126:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784981.961131:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c4b4de5/0x88ace7295d9ea90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.961142:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c4b4de5/0x88ace7295d9ea90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.961151:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c4b4de5/0x88ace7295d9ea90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.961159:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c4b4de5/0x88ace7295d9ea90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.961178:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787784981.961511:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784981.961519:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c6ba4cd/0x88ace7295d9ea89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.961527:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d35a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784981.961531:0:23827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c6ba4cd/0x88ace7295d9ea89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.961540:0:23827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c6ba4cd/0x88ace7295d9ea89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.961567:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c6ba4cd/0x88ace7295d9ea89 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.961575:0:23827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c6ba4cd/0x88ace7295d9ea89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.961607:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784981.961611:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c4b4de5/0x88ace7295d9ea90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.961618:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d35000 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784981.961621:0:23827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c4b4de5/0x88ace7295d9ea90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.961628:0:23827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c4b4de5/0x88ace7295d9ea90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.961639:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c4b4de5/0x88ace7295d9ea90 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.961646:0:23827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c4b4de5/0x88ace7295d9ea90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.961658:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.961660:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.961667:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.961675:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784981.963556:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784981.963568:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032eb0596/0x88ace7295d9ea97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.963809:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1787784981.963815:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784981.963823:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032eb0596/0x88ace7295d9ea97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.963838:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032eb0596/0x88ace7295d9ea97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.963849:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032eb0596/0x88ace7295d9ea97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.963858:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032eb0596/0x88ace7295d9ea97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.963911:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784981.970800:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784981.970814:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ea9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.970831:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1787784981.970836:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784981.970842:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ea9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.970870:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ea9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.970881:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ea9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.970889:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ea9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.971375:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784981.971385:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032eb0596/0x88ace7295d9ea97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.971395:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0030200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784981.971399:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032eb0596/0x88ace7295d9ea97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.971409:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032eb0596/0x88ace7295d9ea97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.971429:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032eb0596/0x88ace7295d9ea97 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.971438:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032eb0596/0x88ace7295d9ea97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.971457:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784981.971461:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ea9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.971468:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784981.971471:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ea9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.971492:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ea9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.971503:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ea9e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.971513:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.971515:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.971517:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784981.980044:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787784981.980058:0:24684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ea9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787784981.980879:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784981.980888:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bb3ba76/0x88ace7295d9eaa5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.980902:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=722s v=(0 0) 00010000:00010000:3.0:1787784981.980907:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784981.980914:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bb3ba76/0x88ace7295d9eaa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.980930:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bb3ba76/0x88ace7295d9eaa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.980957:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bb3ba76/0x88ace7295d9eaa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784981.980965:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bb3ba76/0x88ace7295d9eaa5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.986444:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784981.986463:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bb3ba76/0x88ace7295d9eaa5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.986480:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712e00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784981.986487:0:23827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bb3ba76/0x88ace7295d9eaa5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.986503:0:23827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bb3ba76/0x88ace7295d9eaa5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.986530:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bb3ba76/0x88ace7295d9eaa5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.986698:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.986701:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.986703:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784981.987517:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787784981.987528:0:24684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bb3ba76/0x88ace7295d9eaa5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.989144:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784981.990948:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784981.990962:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001695abed/0x88ace7295d9eaac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.990982:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1787784981.990987:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784981.990994:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001695abed/0x88ace7295d9eaac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.991011:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001695abed/0x88ace7295d9eaac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.991034:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001695abed/0x88ace7295d9eaac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.991042:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001695abed/0x88ace7295d9eaac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.991069:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787784981.991518:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784981.991526:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001695abed/0x88ace7295d9eaac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.991535:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0030400 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784981.991540:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001695abed/0x88ace7295d9eaac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.991550:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001695abed/0x88ace7295d9eaac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.991571:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001695abed/0x88ace7295d9eaac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.991580:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001695abed/0x88ace7295d9eaac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.991616:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.991618:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.991620:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784981.991716:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784981.991723:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032eb0596/0x88ace7295d9eab3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.991733:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1787784981.991737:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784981.991742:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032eb0596/0x88ace7295d9eab3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.991752:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032eb0596/0x88ace7295d9eab3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.991760:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032eb0596/0x88ace7295d9eab3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.991800:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032eb0596/0x88ace7295d9eab3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.991832:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787784981.992087:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784981.992094:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032eb0596/0x88ace7295d9eab3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.992103:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0030200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784981.992107:0:23827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032eb0596/0x88ace7295d9eab3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.992130:0:23827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032eb0596/0x88ace7295d9eab3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.992142:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032eb0596/0x88ace7295d9eab3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.992151:0:23827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032eb0596/0x88ace7295d9eab3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.992165:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.992166:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.992168:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784981.992953:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784981.992964:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcdaaa01/0x88ace7295d9eaba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.992977:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1787784981.992981:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784981.992988:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcdaaa01/0x88ace7295d9eaba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.993001:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcdaaa01/0x88ace7295d9eaba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.993012:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcdaaa01/0x88ace7295d9eaba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.993020:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcdaaa01/0x88ace7295d9eaba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.993044:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787784981.993406:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784981.993415:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcdaaa01/0x88ace7295d9eaba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.993424:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951fda13000 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784981.993429:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcdaaa01/0x88ace7295d9eaba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.993438:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcdaaa01/0x88ace7295d9eaba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.993451:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcdaaa01/0x88ace7295d9eaba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.993471:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcdaaa01/0x88ace7295d9eaba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.993490:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.993492:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784981.993494:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784981.993571:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784981.993577:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007b34218/0x88ace7295d9eac1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.993598:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1787784981.993607:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784981.993612:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007b34218/0x88ace7295d9eac1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.993621:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007b34218/0x88ace7295d9eac1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.993629:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007b34218/0x88ace7295d9eac1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.993637:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007b34218/0x88ace7295d9eac1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.993687:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787784981.995234:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784981.995257:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8287253/0x88ace7295d9eac8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.995272:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1787784981.995275:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784981.995281:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8287253/0x88ace7295d9eac8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.995293:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8287253/0x88ace7295d9eac8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.995302:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8287253/0x88ace7295d9eac8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784981.995315:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8287253/0x88ace7295d9eac8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.999856:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784981.999872:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007b34218/0x88ace7295d9eac1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.999888:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951fda12600 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784981.999893:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007b34218/0x88ace7295d9eac1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.999905:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007b34218/0x88ace7295d9eac1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.999928:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007b34218/0x88ace7295d9eac1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.999936:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007b34218/0x88ace7295d9eac1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.999962:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784981.999966:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8287253/0x88ace7295d9eac8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.999981:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951fda13200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784981.999984:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8287253/0x88ace7295d9eac8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784981.999993:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8287253/0x88ace7295d9eac8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784982.000003:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8287253/0x88ace7295d9eac8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784982.000011:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784982.000013:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784982.000015:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784982.000219:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787784982.000228:0:24684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8287253/0x88ace7295d9eac8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787784982.000862:0:24684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784982.000871:0:24684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016b4f2af/0x88ace7295d9eacf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784982.000885:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=722s v=(0 0) 00010000:00010000:0.0:1787784982.000889:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784982.000897:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016b4f2af/0x88ace7295d9eacf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784982.000908:0:24684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016b4f2af/0x88ace7295d9eacf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784982.000917:0:24684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016b4f2af/0x88ace7295d9eacf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784982.000925:0:24684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016b4f2af/0x88ace7295d9eacf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784982.005861:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784982.005877:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016b4f2af/0x88ace7295d9eacf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784982.005892:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951fda13a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784982.005897:0:23827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016b4f2af/0x88ace7295d9eacf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784982.005910:0:23827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016b4f2af/0x88ace7295d9eacf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784982.005933:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016b4f2af/0x88ace7295d9eacf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784982.005954:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784982.005956:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784982.005959:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784982.006367:0:24684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787784982.006376:0:24684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016b4f2af/0x88ace7295d9eacf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1787784982.006702:0:24684:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1787784982.006828:0:24684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22694:x1874627750263296:12345-0@lo:5:osp-pre-0-0.0 Request processed in 105341us (105740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784982.006840:0:24684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787784982.006962:0:22694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc9680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22694:1874627750263296:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787784982.006980:0:22694:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1787784982.007027:0:22694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c0f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22694:1874627750263424:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787784982.007065:0:22694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784982.007099:0:22694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951e0be1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784982.007147:0:24181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750263424 00000100:00100000:0.0:1787784982.007153:0:24181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750263424 00000100:00100000:0.0:1787784982.007193:0:24181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787784982.007201:0:24181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22694:x1874627750263424:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787784982.007235:0:24181:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:1.0:1787784982.010381:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787784982.013451:0:24176:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:0.0:1787784982.013513:0:24176:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787784982.013714:0:24181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22694:x1874627750263424:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6507us (6643us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1787784982.013726:0:24181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787784982.013820:0:22694:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1787784982.013827:0:22694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c0f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22694:1874627750263424:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787784982.013843:0:22694:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000100:00100000:2.0:1787784982.150015:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784982.150043:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750263552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787784982.150112:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784982.150158:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750263552 00000100:00100000:2.0:1787784982.150166:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750263552 00000100:00100000:2.0:1787784982.150211:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784982.150220:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750263552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787784982.151025:0:24183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787784982.151306:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750263552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1085us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784982.151316:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787784982.155693:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750263552:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787784982.213908:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784982.663316:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951efef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750263680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787784982.663397:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784982.663461:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750263680 00000100:00100000:1.0:1787784982.663469:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750263680 00000100:00100000:1.0:1787784982.663530:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787784982.663540:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750263680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787784982.663575:0:22674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787784982.663629:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750263680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784982.663635:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787784982.663681:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951efef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750263680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787784982.670998:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750263808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787784982.671090:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784982.671172:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750263808 00000100:00100000:1.0:1787784982.671182:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750263808 00000100:00100000:1.0:1787784982.671243:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787784982.671252:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750263808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787784982.671289:0:23412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787784982.671339:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750263808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784982.671346:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787784982.671872:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750263808:0@lo:41:osp-pre-0-1.0 00000020:01000004:2.0:1787784982.875613:0:24994:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787784982.875617:0:24994:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787784982.875618:0:24994:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787784982.875741:0:24994:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8951fa9c6000 00000020:01000004:2.0:1787784982.875758:0:24994:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787784982.876022:0:24994:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787784982.876037:0:24994:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8951f02d99b8) 00000020:00000080:2.0:1787784982.876059:0:24994:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787784982.978413:0:24994:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787784982.985189:0:24994:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787784982.988486:0:24994:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787784982.989432:0:24994:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787784982.989788:0:24994:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787784982.990446:0:24994:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787784982.990699:0:24994:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1787784982.996513:0:24994:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787784982.996749:0:24994:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787784982.997209:0:24994:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787784982.997227:0:24994:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x88ace7295d9eadd 00000020:01000004:2.0:1787784982.997328:0:24994:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787784982.997358:0:24994:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.141@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787784982.997362:0:24994:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787784982.997369:0:24994:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787784982.997402:0:24994:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1787784982.997406:0:24994:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.141@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787784983.015408:0:24994:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787784983.015452:0:24994:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.141@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787784983.015457:0:24994:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787784983.015459:0:24994:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787784983.015460:0:24994:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784983.015462:0:24994:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784983.015463:0:24994:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784983.015464:0:24994:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784983.015466:0:24994:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787784983.015467:0:24994:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784983.015997:0:24994:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787784983.016004:0:24994:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787784983.016007:0:24994:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787784983.016009:0:24994:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787784983.016018:0:24994:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784983.016019:0:24994:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784983.016020:0:24994:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784983.016022:0:24994:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784983.016023:0:24994:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787784983.016024:0:24994:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784983.016024:0:24994:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787784983.016424:0:24994:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787784983.016446:0:24994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3273840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750263936:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787784983.016522:0:24994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784983.016656:0:24994:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24e8840 going to sleep for 11 seconds 00000100:00100000:1.0:1787784983.024956:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750263936 00000100:00100000:1.0:1787784983.024970:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750263936 00000100:00100000:1.0:1787784983.025057:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787784983.025068:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+21:24994:x1874627750263936:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787784983.025109:0:22663:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787784983.025113:0:22663:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787784983.025116:0:22663:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787784983.025652:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+21:24994:x1874627750263936:12345-0@lo:253:mount.lustre.0 Request processed in 586us (9130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784983.025662:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787784983.025762:0:24994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3273840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750263936:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787784983.025795:0:24994:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787784983.025799:0:24994:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787784983.025800:0:24994:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787784983.025802:0:24994:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784983.025803:0:24994:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784983.025805:0:24994:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784983.025806:0:24994:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784983.025808:0:24994:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784983.025810:0:24994:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784983.025811:0:24994:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787784983.025831:0:24994:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8951fa9c6000 from lustre-OST0001 10000000:01000000:2.0:1787784983.025878:0:24994:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787784983.025881:0:24994:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787784983.025890:0:24994:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8951ebd519b8 local copy 00010000:00010000:2.0:1787784983.025900:0:24994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e717 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784983.025999:0:24994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750264064:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784983.026057:0:24994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784983.026094:0:24994:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa95b180 going to sleep for 11 seconds 00000100:00100000:1.0:1787784983.026206:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750264064 00000100:00100000:1.0:1787784983.026211:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750264064 00000100:00100000:1.0:1787784983.026254:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787784983.026263:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+21:24994:x1874627750264064:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784983.026338:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+21:24994:x1874627750264064:12345-0@lo:501:mount.lustre.0 Request processed in 76us (281us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787784983.026345:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787784983.026499:0:24994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750264064:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787784983.026513:0:24994:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787784983.026534:0:24994:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787784983.026540:0:24994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e717 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784983.026555:0:24994:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951d1628000/0x88ace7295d9e710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9e717 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784983.026588:0:24994:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8951fa9c6000 10000000:01000000:3.0:1787784983.026594:0:24994:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787784983.026599:0:24994:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787784983.026602:0:24994:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787784983.026607:0:24994:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787784983.026610:0:24994:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787784983.026632:0:24994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3712e00/0x88ace7295d9eae4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784983.026640:0:24994:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8950c3712e00/0x88ace7295d9eae4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784983.026649:0:24994:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8950c3712e00/0x88ace7295d9eae4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784983.026661:0:24994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750264192:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787784983.026691:0:24994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784983.026723:0:24994:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fbd6ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784983.026787:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750264192 00000100:00100000:2.0:1787784983.026792:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750264192 00000100:00100000:2.0:1787784983.026825:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787784983.026832:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+21:24994:x1874627750264192:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784983.026841:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784983.026853:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1628200/0x88ace7295d9eaeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9eae4 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784983.026875:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1628200/0x88ace7295d9eaeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9eae4 expref: 22 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784983.026885:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1628200/0x88ace7295d9eaeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9eae4 expref: 22 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784983.026894:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628200, rc 0) 00000100:00100000:2.0:1787784983.026923:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+22:24994:x1874627750264192:12345-0@lo:101:mount.lustre.0 Request processed in 92us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784983.026929:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787784983.027009:0:24994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750264192:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784983.027021:0:24994:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8950c3712e00/0x88ace7295d9eae4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9eaeb expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784983.027041:0:24994:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8950c3712e00/0x88ace7295d9eae4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9eaeb expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787784983.031659:0:24994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1787784983.032419:0:24994:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784983.034701:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1787784983.034745:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1787784983.034756:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1787784983.034793:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1787784983.034808:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1787784983.034819:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1787784983.034829:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1787784983.034840:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1787784983.034851:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1787784983.034870:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1787784983.034874:0:24994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1787784983.034991:0:24994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750264320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784983.035372:0:24994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784983.035423:0:24994:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fbd6e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787784983.035618:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750264320 00000100:00100000:2.0:1787784983.035626:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750264320 00000100:00100000:2.0:1787784983.035678:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787784983.035687:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+22:24994:x1874627750264320:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784983.035869:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+22:24994:x1874627750264320:12345-0@lo:501:mount.lustre.0 Request processed in 182us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784983.035879:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787784983.035987:0:24994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750264320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784983.036039:0:24994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750264448:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784983.036090:0:24994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784983.036113:0:24994:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33b5300 going to sleep for 11 seconds 00000100:00100000:1.0:1787784983.036260:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750264448 00000100:00100000:1.0:1787784983.036272:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750264448 00000100:00100000:1.0:1787784983.036309:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787784983.036317:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+22:24994:x1874627750264448:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784983.037184:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+22:24994:x1874627750264448:12345-0@lo:503:mount.lustre.0 Request processed in 864us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784983.037193:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787784983.037321:0:24994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750264448:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787784983.037839:0:24994:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787784983.037930:0:24994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750264576:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784983.037982:0:24994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784983.038014:0:24994:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33b5300 going to sleep for 11 seconds 00000100:00100000:2.0:1787784983.038159:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750264576 00000100:00100000:2.0:1787784983.038175:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750264576 00000100:00100000:2.0:1787784983.038212:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787784983.038221:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+22:24994:x1874627750264576:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784983.038688:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+22:24994:x1874627750264576:12345-0@lo:502:mount.lustre.0 Request processed in 467us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784983.038697:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787784983.038963:0:24994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750264576:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787784983.039335:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1787784983.039365:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1787784983.039380:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1787784983.039392:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1787784983.039403:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1787784983.039416:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1787784983.039426:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1787784983.039439:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1787784983.039463:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:0.0:1787784983.039490:0:24994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750264704:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784983.039537:0:24994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784983.039641:0:24994:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c33b5300 going to sleep for 11 seconds 00000100:00100000:2.0:1787784983.044082:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750264704 00000100:00100000:2.0:1787784983.044098:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750264704 00000100:00100000:2.0:1787784983.044158:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787784983.044168:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+22:24994:x1874627750264704:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784983.044683:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+22:24994:x1874627750264704:12345-0@lo:502:mount.lustre.0 Request processed in 516us (5145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784983.044691:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787784983.045172:0:24994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750264704:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787784983.045491:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1787784983.045506:0:24994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1787784983.051448:0:24998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787784983.051460:0:24998:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1787784983.051467:0:24998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784983.051469:0:24998:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787784983.051475:0:24998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787784983.051491:0:24998:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8950c25b4d28) 00000020:00000080:0.0:1787784983.051523:0:24998:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787784983.051529:0:24998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787784983.051633:0:24998:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951fa9c6000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787784983.051643:0:24998:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787784983.051649:0:24998:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x88ace7295d9eaf9 00010000:00010000:0.0:1787784983.057885:0:24998:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1787784983.058479:0:24998:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:0.0:1787784983.061570:0:24998:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1787784983.063939:0:24998:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787784983.063953:0:24998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784983.063960:0:24998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784983.063962:0:24998:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787784983.063966:0:24998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784983.063971:0:24998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784983.063972:0:24998:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787784983.063975:0:24998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787784983.063977:0:24998:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787784983.063979:0:24998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784983.063981:0:24998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784983.063982:0:24998:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787784983.063985:0:24998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784983.063987:0:24998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784983.063988:0:24998:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787784983.063991:0:24998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787784983.064020:0:24998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784983.064042:0:24998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784983.064043:0:24998:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787784983.064047:0:24998:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1787784983.064500:0:24994:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1787784983.064540:0:24994:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787784983.064565:0:24994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8950c3712e00/0x88ace7295d9eae4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9eaeb expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.064591:0:24994:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8950c3712e00/0x88ace7295d9eae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9eaeb expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784983.064602:0:24994:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951fa9c6000 from 1 10000000:01000000:0.0:1787784983.064612:0:24994:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787784983.064649:0:24994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951fda12000/0x88ace7295d9eb00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.064657:0:24994:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951fda12000/0x88ace7295d9eb00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.064670:0:24994:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951fda12000/0x88ace7295d9eb00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784983.064698:0:24994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750264832:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787784983.064803:0:24994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784983.064848:0:24994:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d249a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784983.064965:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750264832 00000100:00100000:2.0:1787784983.064972:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750264832 00000100:00100000:2.0:1787784983.065018:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787784983.065035:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+22:24994:x1874627750264832:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784983.065049:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784983.065062:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1629000/0x88ace7295d9eb07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9eb00 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784983.065086:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1629000/0x88ace7295d9eb07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9eb00 expref: 23 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784983.065097:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1629000/0x88ace7295d9eb07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9eb00 expref: 23 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784983.065105:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629000, rc 0) 00000100:00100000:2.0:1787784983.065153:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+23:24994:x1874627750264832:12345-0@lo:101:mount.lustre.0 Request processed in 127us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784983.065160:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787784983.065573:0:24994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750264832:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784983.065600:0:24994:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951fda12000/0x88ace7295d9eb00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9eb07 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.065609:0:24994:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951fda12000/0x88ace7295d9eb00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9eb07 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787784983.067049:0:24994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1787784983.067340:0:24994:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787784983.067520:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1787784983.067541:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1787784983.067552:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1787784983.067563:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1787784983.067573:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1787784983.067601:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1787784983.067612:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1787784983.067623:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1787784983.067633:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1787784983.067644:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1787784983.067655:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1787784983.067669:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1787784983.067673:0:24994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1787784983.067760:0:24994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951efef2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750264960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784983.067849:0:24994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784983.067883:0:24994:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c2c92f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784983.068247:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750264960 00000100:00100000:2.0:1787784983.068254:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750264960 00000100:00100000:2.0:1787784983.068473:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787784983.068483:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+23:24994:x1874627750264960:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784983.068599:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+23:24994:x1874627750264960:12345-0@lo:501:mount.lustre.0 Request processed in 117us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784983.068606:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787784983.068687:0:24994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951efef2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750264960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784983.068725:0:24994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951efef2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750265088:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784983.068793:0:24994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784983.076474:0:24994:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c2c92f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787784983.076663:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750265088 00000100:00100000:0.0:1787784983.076674:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750265088 00000100:00100000:0.0:1787784983.076731:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787784983.076740:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+23:24994:x1874627750265088:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784983.076911:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+23:24994:x1874627750265088:12345-0@lo:503:mount.lustre.0 Request processed in 171us (8117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784983.076919:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787784983.077071:0:24994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951efef2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750265088:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787784983.077718:0:24994:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787784983.077825:0:24994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951efef2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750265216:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784983.077882:0:24994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784983.077909:0:24994:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c2c92f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787784983.080852:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750265216 00000100:00100000:0.0:1787784983.080868:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750265216 00000100:00100000:0.0:1787784983.080947:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787784983.080956:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+23:24994:x1874627750265216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784983.081156:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+23:24994:x1874627750265216:12345-0@lo:502:mount.lustre.0 Request processed in 200us (3274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784983.081163:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787784983.081519:0:24994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951efef2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750265216:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787784983.081803:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1787784983.081831:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1787784983.081842:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1787784983.081852:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1787784983.081863:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1787784983.081873:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1787784983.081884:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1787784983.081895:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1787784983.081906:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1787784983.081916:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1787784983.081927:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1787784983.081958:0:24994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951efef2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750265344:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784983.082004:0:24994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784983.082149:0:24994:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c2c92f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787784983.082206:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750265344 00000100:00100000:0.0:1787784983.082211:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750265344 00000100:00100000:0.0:1787784983.082410:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787784983.082420:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+23:24994:x1874627750265344:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784983.082513:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+23:24994:x1874627750265344:12345-0@lo:502:mount.lustre.0 Request processed in 94us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784983.082520:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787784983.082647:0:24994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951efef2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750265344:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787784983.082688:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1787784983.082697:0:24994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1787784983.083438:0:25002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784983.083453:0:25002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784983.083456:0:25002:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787784983.083462:0:25002:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8951fa9c6000 00000020:00000080:2.0:1787784983.083465:0:25002:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787784983.083472:0:25002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784983.083474:0:25002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784983.083475:0:25002:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787784983.083477:0:25002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784983.083480:0:25002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784983.083481:0:25002:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787784983.083484:0:25002:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8951fa9c6000 00000020:00000080:2.0:1787784983.083486:0:25002:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787784983.083541:0:25002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784983.083544:0:25002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784983.083545:0:25002:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787784983.083547:0:25002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784983.083550:0:25002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784983.083551:0:25002:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787784983.083554:0:25002:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8951fa9c6000 00000020:00000080:2.0:1787784983.083556:0:25002:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787784983.083570:0:25002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784983.083572:0:25002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784983.083574:0:25002:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787784983.083587:0:25002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784983.083590:0:25002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784983.083592:0:25002:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787784983.083595:0:25002:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8951fa9c6000 00000020:00000080:2.0:1787784983.083597:0:25002:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787784983.083616:0:25002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784983.083619:0:25002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784983.083620:0:25002:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787784983.083623:0:25002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1787784983.090909:0:24994:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787784983.090957:0:24994:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787784983.090984:0:24994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951fda12000/0x88ace7295d9eb00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9eb07 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.090997:0:24994:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951fda12000/0x88ace7295d9eb00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9eb07 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784983.091070:0:24994:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787784983.091074:0:24994:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8951fa9c6000 10000000:01000000:0.0:1787784983.091077:0:24994:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8951fa9c6000 10000000:01000000:0.0:1787784983.091082:0:24994:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787784983.091089:0:24994:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8951fa9c6000 from 1 10000000:01000000:0.0:1787784983.091092:0:24994:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787784983.091132:0:24994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951fda13800/0x88ace7295d9eb0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.091154:0:24994:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951fda13800/0x88ace7295d9eb0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.091167:0:24994:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951fda13800/0x88ace7295d9eb0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784983.091193:0:24994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750265472:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787784983.091433:0:24994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784983.099691:0:24994:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c52af840 going to sleep for 11 seconds 00000100:00100000:0.0:1787784983.100598:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750265472 00000100:00100000:0.0:1787784983.100611:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750265472 00000100:00100000:0.0:1787784983.100680:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787784983.100690:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+23:24994:x1874627750265472:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784983.100708:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784983.100728:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951fda12400/0x88ace7295d9eb15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9eb0e expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.100760:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951fda12400/0x88ace7295d9eb15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9eb0e expref: 24 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.100791:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951fda12400/0x88ace7295d9eb15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9eb0e expref: 24 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.100802:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951fda12400, rc 0) 00000100:00100000:0.0:1787784983.100867:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+24:24994:x1874627750265472:12345-0@lo:101:mount.lustre.0 Request processed in 179us (9435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784983.100875:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787784983.100959:0:24994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750265472:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784983.100976:0:24994:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951fda13800/0x88ace7295d9eb0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9eb15 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.100985:0:24994:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951fda13800/0x88ace7295d9eb0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9eb15 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787784983.103714:0:24994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1787784983.105170:0:24994:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787784983.107444:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1787784983.107497:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1787784983.107514:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1787784983.107527:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1787784983.107539:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1787784983.107551:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1787784983.107564:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1787784983.107815:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1787784983.107836:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1787784983.107848:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1787784983.107861:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1787784983.107874:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1787784983.107887:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1787784983.107916:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1787784983.107930:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1787784983.107942:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1787784983.107954:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1787784983.107966:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1787784983.107976:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1787784983.107987:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1787784983.107999:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1787784983.108012:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1787784983.108024:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1787784983.109510:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1787784983.109528:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1787784983.109541:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1787784983.109554:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1787784983.109566:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1787784983.109590:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1787784983.109626:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1787784983.109640:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1787784983.109652:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1787784983.109665:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1787784983.109678:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1787784983.109690:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1787784983.109702:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1787784983.109715:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1787784983.109729:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1787784983.109743:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1787784983.109757:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1787784983.109796:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1787784983.109814:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1787784983.109825:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1787784983.109844:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1787784983.109857:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1787784983.109886:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1787784983.109902:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1787784983.109915:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1787784983.112688:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1787784983.112761:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1787784983.113145:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1787784983.113154:0:24994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1787784983.113436:0:24994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750265600:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784983.113513:0:24994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784983.115680:0:24994:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c52afcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784983.120933:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750265600 00000100:00100000:2.0:1787784983.120948:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750265600 00000100:00100000:2.0:1787784983.121138:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787784983.121151:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+24:24994:x1874627750265600:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784983.121359:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+24:24994:x1874627750265600:12345-0@lo:501:mount.lustre.0 Request processed in 211us (7845us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784983.121517:0:24994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750265600:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784983.121568:0:24994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750265728:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784983.121632:0:24994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784983.121666:0:24994:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c52afcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784983.121684:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750265728 00000100:00100000:0.0:1787784983.121688:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750265728 00000100:00100000:2.0:1787784983.125141:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787784983.129446:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787784983.129470:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+24:24994:x1874627750265728:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784983.129684:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+24:24994:x1874627750265728:12345-0@lo:503:mount.lustre.0 Request processed in 223us (8051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784983.129693:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787784983.129823:0:24994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750265728:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787784983.130345:0:24994:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787784983.130428:0:24994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750265856:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784983.130483:0:24994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784983.132456:0:24994:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24e8840 going to sleep for 11 seconds 00000100:00100000:3.0:1787784983.132515:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750265856 00000100:00100000:3.0:1787784983.132523:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750265856 00000100:00100000:3.0:1787784983.132568:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787784983.132588:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+24:24994:x1874627750265856:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784983.132733:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+24:24994:x1874627750265856:12345-0@lo:502:mount.lustre.0 Request processed in 155us (2248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784983.132741:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787784983.132920:0:24994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750265856:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787784983.133413:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1787784983.133448:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1787784983.133462:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1787784983.133487:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1787784983.133501:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1787784983.133515:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1787784983.133528:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1787784983.133541:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1787784983.133554:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1787784983.133568:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1787784983.133596:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1787784983.133610:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1787784983.133622:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1787784983.133635:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1787784983.133648:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1787784983.133660:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1787784983.133672:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1787784983.133684:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1787784983.133695:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1787784983.133707:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1787784983.133718:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1787784983.133729:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1787784983.133741:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1787784983.133753:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1787784983.133765:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1787784983.134160:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1787784983.134174:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1787784983.134186:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1787784983.134198:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1787784983.134209:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1787784983.134221:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1787784983.134335:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1787784983.134355:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1787784983.134369:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1787784983.134381:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1787784983.134394:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1787784983.134419:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1787784983.134433:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1787784983.134444:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1787784983.134456:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1787784983.134469:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1787784983.134480:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1787784983.134492:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1787784983.134521:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1787784983.134537:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1787784983.134550:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1787784983.134563:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1787784983.134587:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1787784983.134645:0:24994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951efef2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750265984:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784983.134712:0:24994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784983.134760:0:24994:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d24e8840 going to sleep for 11 seconds 00000100:00100000:3.0:1787784983.135139:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750265984 00000100:00100000:3.0:1787784983.135147:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750265984 00000100:00100000:3.0:1787784983.135192:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787784983.135201:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+24:24994:x1874627750265984:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784983.136435:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+24:24994:x1874627750265984:12345-0@lo:502:mount.lustre.0 Request processed in 1226us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784983.136448:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787784983.136572:0:24994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951efef2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750265984:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787784983.137001:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1787784983.137651:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1787784983.137695:0:24994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951efef2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750266112:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784983.137756:0:24994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784983.137826:0:24994:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d249a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784983.137941:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750266112 00000100:00100000:0.0:1787784983.137948:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750266112 00000100:00100000:0.0:1787784983.137998:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787784983.138006:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+24:24994:x1874627750266112:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784983.138126:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+24:24994:x1874627750266112:12345-0@lo:502:mount.lustre.0 Request processed in 120us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784983.138133:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787784983.138272:0:24994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951efef2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750266112:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787784983.138332:0:24994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1787784983.138340:0:24994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787784983.139118:0:25007:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787784983.139133:0:25007:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8951e6524d28) 00000020:00000080:1.0:1787784983.139157:0:25007:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1787784983.139376:0:25007:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951fa9c6000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787784983.139381:0:25007:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951fa9c6000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787784983.139389:0:25007:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951fa9c6000 3 00010000:00080000:1.0:1787784983.139418:0:25007:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8950c436e800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1787784983.146445:0:25007:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1787784983.146699:0:25007:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787784983.146751:0:25007:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787784983.147523:0:25007:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x88ace7295d9eb23 00000100:00080000:1.0:1787784983.147538:0:25007:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787784983.147545:0:25007:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8950c436e800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784983.147594:0:25007:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951efef2940 x1874627750266240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787784983.147636:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951efef2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874627750266240:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787784983.147716:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787784983.147797:0:25007:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787784983.147852:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784983.147857:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787784983.147860:0:37:0:(import.c:65:import_set_state_nolock()) ffff8951f67dc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787784983.147864:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 722 00000100:00080000:1.0:1787784983.147867:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787784983.147871:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8951f67dc000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784983.147884:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951efef2580 x1874627750266624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787784983.147915:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784983.147918:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787784983.147920:0:37:0:(import.c:65:import_set_state_nolock()) ffff8950c259a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787784983.147923:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 722 00000100:00080000:1.0:1787784983.147925:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787784983.147937:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8950c259a000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784983.147949:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951ff021e00 x1874627750267136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787784983.147992:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951efef3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750266368:0@lo:400:kworker.0 00000100:00100000:1.0:1787784983.148023:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784983.150391:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff023840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750266752:0@lo:400:kworker.0 00000100:00100000:3.0:1787784983.150468:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784983.150503:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750267392:0@lo:400:kworker.0 00000100:00100000:3.0:1787784983.150529:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784983.150559:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787784983.150565:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951efef1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750266496:0@lo:400:kworker.0 00000100:00100000:3.0:1787784983.150601:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784983.150619:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750267264:0@lo:400:kworker.0 00000100:00100000:3.0:1787784983.150638:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784983.150665:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff021a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750266880:0@lo:400:kworker.0 00000100:00100000:1.0:1787784983.150983:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750267008:0@lo:400:kworker.0 00000100:00100000:1.0:1787784983.151010:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784983.151065:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951efef2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750266624:0@lo:8:kworker.0 00000100:00100000:1.0:1787784983.151094:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784983.151111:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff021e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750267136:0@lo:8:kworker.0 00000100:00100000:1.0:1787784983.151133:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784983.151166:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750266240 00000100:00100000:1.0:1787784983.151172:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750266240 00000100:00100000:1.0:1787784983.151195:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750266752 00000100:00100000:1.0:1787784983.151198:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750266752 00000100:00100000:1.0:1787784983.151218:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750267392 00000100:00100000:1.0:1787784983.151220:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750267392 00000100:00100000:1.0:1787784983.151382:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750267264 00000100:00100000:1.0:1787784983.151386:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750267264 00000100:00100000:1.0:1787784983.151401:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787784983.151409:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750266752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784983.151467:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874627750266752:12345-0@lo:400:kworker.0 Request processed in 58us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784983.151474:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787784983.151489:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787784983.151495:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750267392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784983.151537:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874627750267392:12345-0@lo:400:kworker.0 Request processed in 42us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784983.151544:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787784983.151556:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787784983.151562:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750267264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784983.151602:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750267264:12345-0@lo:400:kworker.0 Request processed in 41us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784983.151608:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787784983.151621:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784983.151625:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1874627750266240:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787784983.151645:0:22670:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 723 last 0 00000020:00000080:1.0:1787784983.151690:0:22670:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x88ace7295d9eb2a 00000004:00100000:1.0:1787784983.151706:0:22670:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787784983.151738:0:22670:0:(import.c:65:import_set_state_nolock()) ffff8950c436a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784983.151818:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1874627750266240:12345-0@lo:38:llog_process_th.0 Request processed in 190us (4102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784983.151824:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784983.151847:0:24182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750266496 00000100:00100000:1.0:1787784983.151850:0:24182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750266496 00000100:00100000:1.0:1787784983.151866:0:24182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750267008 00000100:00100000:1.0:1787784983.151868:0:24182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750267008 00000100:00100000:1.0:1787784983.151879:0:24182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750266624 00000100:00100000:1.0:1787784983.151881:0:24182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750266624 00000100:00100000:1.0:1787784983.151888:0:24182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750267136 00000100:00100000:1.0:1787784983.151890:0:24182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750267136 00000100:00100000:1.0:1787784983.151898:0:24182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784983.151903:0:24182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750266496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784983.151939:0:24182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750266496:12345-0@lo:400:kworker.0 Request processed in 36us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784983.151946:0:24182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784983.151957:0:24182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787784983.151962:0:24182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750267008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784983.151989:0:24182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750267008:12345-0@lo:400:kworker.0 Request processed in 27us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784983.151995:0:24182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787784983.152005:0:24182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787784983.152009:0:24182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1874627750266624:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787784983.152133:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750266368 00000100:00100000:3.0:1787784983.152138:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750266368 00000100:00100000:3.0:1787784983.152168:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787784983.152174:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750266368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784983.152211:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750266368:12345-0@lo:400:kworker.0 Request processed in 37us (4187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784983.152217:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787784983.153183:0:24182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1874627750266624:12345-0@lo:8:kworker.0 Request processed in 1166us (2082us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787784983.153194:0:24182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787784983.153215:0:24182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787784983.153220:0:24182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1874627750267136:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787784983.153429:0:24182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1874627750267136:12345-0@lo:8:kworker.0 Request processed in 207us (2294us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787784983.153435:0:24182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1787784983.153457:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787784983.153462:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784983.153490:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787784983.153497:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951f67dc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784983.153502:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787784983.153506:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951efef2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750266624:0@lo:8:kworker.0 00000100:00100000:1.0:1787784983.153517:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787784983.153520:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c259a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784983.153530:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787784983.153533:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff021e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750267136:0@lo:8:kworker.0 00010000:00080000:1.0:1787784983.153551:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951efef2940 x1874627750266240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784983.153560:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787784983.153565:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1787784983.153574:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787784983.153589:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787784983.153592:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c436e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787784983.153597:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951efef2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1874627750266240:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787784983.153648:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784983.153731:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750267520:0@lo:400:kworker.0 00000100:00100000:1.0:1787784983.153760:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784983.153811:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750267520 00000100:00100000:1.0:1787784983.153817:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750267520 00000100:00100000:1.0:1787784983.153853:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787784983.153860:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750267520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784983.153896:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750267520:12345-0@lo:400:kworker.0 Request processed in 36us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784983.153902:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787784983.153918:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787784983.153932:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951ff0221c0 x1874627750267520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784983.153942:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750267520:0@lo:400:kworker.0 00000100:00100000:1.0:1787784983.153967:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951efef1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750266496:0@lo:400:kworker.0 00010000:00080000:1.0:1787784983.153988:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951ff0203c0 x1874627750267264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784983.153998:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750267264:0@lo:400:kworker.0 00010000:00080000:1.0:1787784983.154009:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951ff023840 x1874627750266752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784983.154016:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff023840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874627750266752:0@lo:400:kworker.0 00010000:00080000:1.0:1787784983.154104:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951ff0230c0 x1874627750267392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784983.154114:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1874627750267392:0@lo:400:kworker.0 00000100:00100000:1.0:1787784983.154149:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951efef3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750266368:0@lo:400:kworker.0 00000100:00100000:1.0:1787784983.154161:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750267008:0@lo:400:kworker.0 00000020:01000004:0.0:1787784983.157979:0:25007:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787784983.157998:0:25007:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8950c25b0000) 00000020:00000080:0.0:1787784983.158036:0:25007:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1787784983.158123:0:25007:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8951fa9c6000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787784983.158127:0:25007:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8951fa9c6000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787784983.158130:0:25007:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8951fa9c6000 3 00010000:00080000:0.0:1787784983.158159:0:25007:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8950c3534000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.141@tcp at head 00010000:00010000:0.0:1787784983.166764:0:25007:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000100:00100000:3.0:1787784983.167844:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750266880 00000100:00100000:3.0:1787784983.167855:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750266880 00000100:00100000:3.0:1787784983.167917:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787784983.167926:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750266880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784983.168045:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750266880:12345-0@lo:400:kworker.0 Request processed in 119us (14395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784983.168064:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787784983.172430:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff021a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750266880:0@lo:400:kworker.0 00000020:00000080:1.0:1787784983.174488:0:25007:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1787784983.174715:0:25007:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787784983.174732:0:25007:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x88ace7295d9eb38 00000100:00080000:1.0:1787784983.174745:0:25007:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787784983.174751:0:25007:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8950c3534000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1787784983.174912:0:25007:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951d1b5f480 x1874627750267648/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787784983.174946:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1874627750267648:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787784983.175036:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784983.175103:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750267648 00000100:00100000:1.0:1787784983.175117:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750267648 00000100:00100000:1.0:1787784983.175149:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787784983.175157:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1874627750267648:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787784983.175180:0:22670:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 723 last 0 00000020:00000080:1.0:1787784983.175208:0:22670:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x88ace7295d9eb3f 00000004:00100000:1.0:1787784983.175223:0:22670:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787784983.175263:0:22670:0:(import.c:65:import_set_state_nolock()) ffff8950c4369000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784983.175312:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1874627750267648:12345-0@lo:38:llog_process_th.0 Request processed in 154us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784983.175320:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787784983.175355:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8951d1b5f480 x1874627750267648/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784983.175378:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787784983.175386:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1787784983.175392:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787784983.175396:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787784983.175398:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c3534000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787784983.175404:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1874627750267648:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787784983.175420:0:25007:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1787784983.181314:0:25007:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1787784983.181453:0:24994:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787784983.181507:0:24994:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787784983.181530:0:24994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951fda13800/0x88ace7295d9eb0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9eb15 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784983.181540:0:24994:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951fda13800/0x88ace7295d9eb0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9eb15 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787784983.181601:0:24994:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787784983.181604:0:24994:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787784983.181605:0:24994:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784983.181607:0:24994:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784983.181608:0:24994:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784983.181610:0:24994:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784983.181611:0:24994:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784983.181613:0:24994:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784983.181614:0:24994:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787784983.181619:0:24994:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787784983.181622:0:24994:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787784983.181623:0:24994:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787784983.181629:0:24994:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784983.181631:0:24994:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784983.181631:0:24994:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784983.181633:0:24994:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784983.181634:0:24994:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784983.181635:0:24994:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784983.181636:0:24994:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787784983.181663:0:24994:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787784983.181684:0:24994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750267776:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787784983.181755:0:24994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784983.181923:0:24994:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fa9e6900 going to sleep for 11 seconds 00000100:00100000:0.0:1787784983.182163:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750267776 00000100:00100000:0.0:1787784983.182177:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750267776 00000100:00100000:0.0:1787784983.182325:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787784983.182337:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+24:24994:x1874627750267776:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787784983.182367:0:22662:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787784983.182381:0:22662:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787784983.183919:0:22662:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787784983.183936:0:22662:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787784983.184262:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+24:24994:x1874627750267776:12345-0@lo:253:mount.lustre.0 Request processed in 1923us (2502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784983.184273:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787784983.184366:0:24994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e11354d-250d-4393-8e0e-7593eb008ce7:24994:1874627750267776:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787784983.184380:0:24994:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787784983.184383:0:24994:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787784983.184385:0:24994:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787784983.184386:0:24994:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787784983.184387:0:24994:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787784983.184388:0:24994:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787784983.184389:0:24994:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787784983.184391:0:24994:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787784983.184393:0:24994:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787784983.184394:0:24994:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787784983.184407:0:24994:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1787784983.185142:0:22685:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787784983.185147:0:22685:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787784983.185167:0:22685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8951fda13c00/0x88ace7295d9eb46 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.185182:0:22685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951c151fa00/0x88ace7295d9e9d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e9cc expref: 23 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.185190:0:22685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951df602e00/0x88ace7295d9e9e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e9da expref: 23 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.185198:0:22685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8951fda13c00/0x88ace7295d9eb46 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.185245:0:22685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951df602e00/0x88ace7295d9e9e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9e9da expref: 23 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.185262:0:22685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951df602e00/0x88ace7295d9e9e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9e9da expref: 23 pid: 22663 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784983.185275:0:22685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22685:1874627750267904:0@lo:104: 00000100:00100000:0.0:1787784983.185327:0:22685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787784983.185389:0:22685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951c151fa00/0x88ace7295d9e9d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9e9cc expref: 23 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.185397:0:22685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951c151fa00/0x88ace7295d9e9d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9e9cc expref: 23 pid: 22664 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784983.185415:0:22685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22685:1874627750268032:0@lo:104: 00000100:00100000:0.0:1787784983.185437:0:22685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784983.185457:0:22685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c52afc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787784983.185479:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750267904 00000100:00100000:0.0:1787784983.185486:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750267904 00000100:00100000:0.0:1787784983.185515:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750268032 00000100:00100000:0.0:1787784983.185518:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750268032 00000100:00100000:0.0:1787784983.185531:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787784983.185539:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3270780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+4:22685:x1874627750267904:12345-0@lo:104: 00010000:00010000:0.0:1787784983.185551:0:22653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951df602000/0x88ace7295d9e9da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e9e1 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.185611:0:22653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787784983.185617:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3270780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+4:22685:x1874627750267904:12345-0@lo:104: Request processed in 79us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784983.185624:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787784983.185639:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787784983.185645:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3273840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+3:22685:x1874627750268032:12345-0@lo:104: 00010000:00010000:0.0:1787784983.185652:0:22653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951df603e00/0x88ace7295d9e9cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e9d3 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.185685:0:22653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787784983.185690:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3273840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+3:22685:x1874627750268032:12345-0@lo:104: Request processed in 46us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784983.185695:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787784983.185711:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787784983.185717:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951df602000/0x88ace7295d9e9da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e9e1 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.185730:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602000 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784983.185734:0:23827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951df602000/0x88ace7295d9e9da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9e9e1 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.185744:0:23827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951df602000/0x88ace7295d9e9da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9e9e1 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784983.185751:0:23827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951df602000/0x88ace7295d9e9da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9e9e1 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784983.185756:0:23827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787784983.185807:0:23827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951df602000/0x88ace7295d9e9da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e9e1 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.185814:0:23827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784983.185835:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951df602000/0x88ace7295d9e9da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e9e1 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.185842:0:23827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951df602000/0x88ace7295d9e9da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e9e1 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.185852:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784983.185855:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951df603e00/0x88ace7295d9e9cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e9d3 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.185861:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603e00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:0.0:1787784983.185864:0:23827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951df603e00/0x88ace7295d9e9cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9e9d3 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.185882:0:23827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951df603e00/0x88ace7295d9e9cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9e9d3 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784983.185888:0:23827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951df603e00/0x88ace7295d9e9cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9e9d3 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784983.185894:0:23827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787784983.185907:0:23827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951df603e00/0x88ace7295d9e9cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e9d3 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.185913:0:23827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784983.185930:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951df603e00/0x88ace7295d9e9cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e9d3 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.185937:0:23827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951df603e00/0x88ace7295d9e9cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e9d3 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.185949:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784983.185951:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784983.185953:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784983.185959:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784983.185977:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e11354d-250d-4393-8e0e-7593eb008ce7:3645:1874627750268160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784983.186006:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784983.186218:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784983.186282:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3273c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e11354d-250d-4393-8e0e-7593eb008ce7:3647:1874627750268288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784983.186309:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784983.187000:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750268160 00000100:00100000:3.0:1787784983.187009:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750268160 00010000:00010000:2.0:1787784983.187221:0:22657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951df602e00/0x88ace7295d9e9e1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e9da expref: 24 pid: 22663 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784983.187328:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750268288 00000100:00100000:2.0:1787784983.187332:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750268288 00010000:00010000:2.0:1787784983.187346:0:22657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951c151fa00/0x88ace7295d9e9d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e9cc expref: 25 pid: 22664 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784983.187361:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787784983.187369:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c32721c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e11354d-250d-4393-8e0e-7593eb008ce7+25:3645:x1874627750268160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784983.187381:0:22657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784983.187387:0:22657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951df602e00/0x88ace7295d9e9e1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e9da expref: 25 pid: 22663 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784983.187399:0:22657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951df602e00/0x88ace7295d9e9e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9e9da expref: 25 pid: 22663 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784983.187417:0:22657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784983.187506:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c32721c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e11354d-250d-4393-8e0e-7593eb008ce7+25:3645:x1874627750268160:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (1498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784983.187515:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787784983.187541:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787784983.187547:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c32730c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e11354d-250d-4393-8e0e-7593eb008ce7+24:3647:x1874627750268288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784983.187554:0:22657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784983.187559:0:22657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951c151fa00/0x88ace7295d9e9d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e9cc expref: 24 pid: 22664 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784983.187569:0:22657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951c151fa00/0x88ace7295d9e9d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9e9cc expref: 24 pid: 22664 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784983.187592:0:22657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8951fda13c00/0x88ace7295d9eb46 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784983.187600:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951fda13c00/0x88ace7295d9eb46 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787784983.187615:0:22657:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005650253s 00010000:00010000:2.0:1787784983.187619:0:22657:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951fda13c00/0x88ace7295d9eb46 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784983.187626:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951fda13c00/0x88ace7295d9eb46 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784983.187634:0:22657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8951fda13c00/0x88ace7295d9eb46 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784983.187641:0:22657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8951fda13c00/0x88ace7295d9eb46 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784983.187648:0:22657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951fda13c00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784983.187652:0:22657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8951fda13c00/0x88ace7295d9eb46 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784983.187669:0:22657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8951fda13c00/0x88ace7295d9eb46 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784983.187678:0:22657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8951fda13c00/0x88ace7295d9eb46 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784983.187689:0:22657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784983.187719:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c32730c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e11354d-250d-4393-8e0e-7593eb008ce7+24:3647:x1874627750268288:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784983.187726:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787784983.187757:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3273c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e11354d-250d-4393-8e0e-7593eb008ce7:3647:1874627750268288:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784983.188412:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df602e00/0x88ace7295d9e9e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9e9da expref: 23 pid: 22663 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784983.188435:0:22685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22685:1874627750267904:0@lo:104: 00010000:00010000:0.0:1787784983.188447:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c151fa00/0x88ace7295d9e9d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9e9cc expref: 22 pid: 22664 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784983.188456:0:22685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22685:1874627750268032:0@lo:104: 00010000:00010000:0.0:1787784983.188470:0:22685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8951fda13c00/0x88ace7295d9eb46 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.188480:0:22685:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8951fda13c00/0x88ace7295d9eb46 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.188486:0:22685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8951fda13c00/0x88ace7295d9eb46 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784983.188493:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951fda13c00/0x88ace7295d9eb46 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1787784983.189666:0:24994:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1787784983.191844:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e11354d-250d-4393-8e0e-7593eb008ce7:3645:1874627750268160:0@lo:103:ldlm_bl.0 00002000:00080000:1.0:1787784983.194607:0:24994:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787784983.194630:0:24994:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787784983.194680:0:24994:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787784983.194730:0:24994:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.141@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787784983.194748:0:24994:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1787784983.194876:0:24994:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1787784983.195915:0:24994:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787784983.197569:0:24994:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787784983.247421:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787784983.622405:0:23428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1787784984.234099:0:25060:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787784984.234309:0:25060:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1787784984.264884:0:22668:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787784984.264893:0:22668:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8951f81b5800 from 14 10000000:01000000:0.0:1787784984.264898:0:22668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787784984.264950:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951fda13400/0x88ace7295d9eb4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784984.264962:0:22668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951fda13400/0x88ace7295d9eb4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784984.264974:0:22668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951fda13400/0x88ace7295d9eb4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784984.265023:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750268416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787784984.265939:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784984.265990:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c52af000 going to sleep for 11 seconds 00000100:00100000:0.0:1787784984.266014:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750268416 00000100:00100000:0.0:1787784984.266021:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750268416 00000100:00100000:0.0:1787784984.266071:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787784984.266081:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+22:22668:x1874627750268416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784984.266174:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784984.266191:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951fda12a00/0x88ace7295d9eb54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9eb4d expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784984.266218:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951fda12a00/0x88ace7295d9eb54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9eb4d expref: 23 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784984.266818:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951fda12a00/0x88ace7295d9eb54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9eb4d expref: 23 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784984.266828:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951fda12a00, rc 0) 00000100:00100000:0.0:1787784984.266888:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+23:22668:x1874627750268416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 808us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784984.266896:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787784984.266954:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750268416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784984.266971:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951fda13400/0x88ace7295d9eb4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9eb54 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784984.266981:0:22668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951fda13400/0x88ace7295d9eb4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9eb54 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784984.267046:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750268544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787784984.267085:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784984.267181:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c52af000 going to sleep for 11 seconds 00000100:00100000:0.0:1787784984.267196:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750268544 00000100:00100000:0.0:1787784984.267202:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750268544 00000100:00100000:0.0:1787784984.267804:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787784984.267816:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+23:22668:x1874627750268544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787784984.267835:0:22662:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787784984.267852:0:22662:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787784984.267855:0:22662:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1787784984.267946:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+23:22668:x1874627750268544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784984.267954:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787784984.268000:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750268544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787784984.268070:0:22668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787784984.268079:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951fda13400/0x88ace7295d9eb4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9eb54 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784984.268162:0:22668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951fda13400/0x88ace7295d9eb4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9eb54 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784984.268174:0:22668:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787784984.268177:0:22668:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8951ff20c000 from 14 10000000:01000000:0.0:1787784984.268180:0:22668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787784984.268202:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951fda12e00/0x88ace7295d9eb5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784984.268220:0:22668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951fda12e00/0x88ace7295d9eb5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784984.268805:0:22668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951fda12e00/0x88ace7295d9eb5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784984.268824:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750268672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787784984.268859:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784984.268886:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c52af000 going to sleep for 11 seconds 00000100:00100000:0.0:1787784984.274934:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750268672 00000100:00100000:0.0:1787784984.274946:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750268672 00000100:00100000:0.0:1787784984.275003:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787784984.275014:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+23:22668:x1874627750268672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784984.275033:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784984.275050:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951fda12800/0x88ace7295d9eb62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9eb5b expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784984.275078:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951fda12800/0x88ace7295d9eb62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9eb5b expref: 24 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784984.275089:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951fda12800/0x88ace7295d9eb62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9eb5b expref: 24 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784984.275098:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951fda12800, rc 0) 00000100:00100000:0.0:1787784984.275174:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+24:22668:x1874627750268672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (6313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784984.275181:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787784984.275252:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750268672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784984.275269:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951fda12e00/0x88ace7295d9eb5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9eb62 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784984.275280:0:22668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951fda12e00/0x88ace7295d9eb5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9eb62 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784984.275340:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750268800:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787784984.275373:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784984.275400:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c52af000 going to sleep for 11 seconds 00000100:00100000:0.0:1787784984.275411:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750268800 00000100:00100000:0.0:1787784984.275415:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750268800 00000100:00100000:0.0:1787784984.275434:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787784984.275439:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+24:22668:x1874627750268800:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787784984.275451:0:22664:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787784984.275467:0:22664:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787784984.275470:0:22664:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1787784984.275531:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+24:22668:x1874627750268800:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 91us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784984.275538:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787784984.275564:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750268800:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787784984.275623:0:22668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787784984.275629:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951fda12e00/0x88ace7295d9eb5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9eb62 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784984.275637:0:22668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951fda12e00/0x88ace7295d9eb5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9eb62 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784984.295224:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784985.285916:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784986.311308:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784987.270448:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784987.270473:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750268928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787784987.270551:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784987.270594:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750268928 00000100:00100000:2.0:1787784987.270601:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750268928 00000100:00100000:2.0:1787784987.270668:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784987.270677:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750268928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787784987.270712:0:24183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787784987.270755:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750268928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784987.270802:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787784987.270824:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784987.270865:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750268928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784987.270969:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787784987.270980:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750269056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784987.271011:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784987.271079:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750269056 00000100:00100000:2.0:1787784987.271083:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750269056 00000100:00100000:2.0:1787784987.271260:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787784987.271266:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750269056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787784987.271276:0:24183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787784987.271310:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750269056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784987.271316:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787784987.271345:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750269056:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787784987.273120:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787784987.335033:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784987.783579:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784987.783610:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750269184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787784987.783686:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784987.783748:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750269184 00000100:00100000:3.0:1787784987.783755:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750269184 00000100:00100000:3.0:1787784987.783833:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787784987.783844:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750269184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787784987.783880:0:23412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787784987.783933:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750269184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784987.783956:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787784987.784008:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750269184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787784987.795523:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784987.795559:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750269312:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787784987.795639:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784987.795871:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750269312 00000100:00100000:2.0:1787784987.795880:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750269312 00000100:00100000:2.0:1787784987.795942:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787784987.795954:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3272d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750269312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787784987.795998:0:22675:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787784987.796097:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3272d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750269312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784987.796104:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787784987.800371:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750269312:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1787784988.303845:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787784988.303854:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787784988.303858:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8951f67dc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787784988.303871:0:15021:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8951f67dc000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1787784988.303897:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951c12ac780 x1874627750269696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787784988.303930:0:15021:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787784988.303933:0:15021:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787784988.303935:0:15021:0:(import.c:65:import_set_state_nolock()) ffff8950c259a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787784988.303940:0:15021:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8950c259a000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1787784988.303950:0:15021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8951c12ae940 x1874627750270080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787784988.304002:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750269952:0@lo:400:kworker.0 00000100:00100000:3.0:1787784988.304069:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784988.304104:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750270592:0@lo:400:kworker.0 00000100:00100000:3.0:1787784988.304133:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784988.304157:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787784988.304163:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fd7c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e11354d-250d-4393-8e0e-7593eb008ce7:3646:1874627750269440:0@lo:400:kworker.0 00000100:00100000:3.0:1787784988.304191:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784988.304217:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750270208:0@lo:400:kworker.0 00000100:00100000:3.0:1787784988.304237:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784988.304265:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750270720:0@lo:400:kworker.0 00000100:00100000:3.0:1787784988.304290:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784988.304316:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750269568:0@lo:400:kworker.0 00000100:00100000:3.0:1787784988.304337:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784988.304353:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750270336:0@lo:400:kworker.0 00000100:00100000:3.0:1787784988.304371:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784988.304383:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787784988.304387:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750269824:0@lo:400:kworker.0 00000100:00100000:3.0:1787784988.304404:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784988.304413:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750270464:0@lo:400:kworker.0 00000100:00100000:3.0:1787784988.304436:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784988.304459:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750269696:0@lo:8:kworker.0 00000100:00100000:3.0:1787784988.304482:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784988.304510:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750270080:0@lo:8:kworker.0 00000100:00100000:3.0:1787784988.304543:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784988.304577:0:24182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750269952 00000100:00100000:3.0:1787784988.304584:0:24182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750269952 00000100:00100000:0.0:1787784988.304969:0:24684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750269568 00000100:00100000:0.0:1787784988.304974:0:24684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750269568 00000100:00100000:0.0:1787784988.304996:0:24684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750269696 00000100:00100000:0.0:1787784988.304999:0:24684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750269696 00000100:00100000:0.0:1787784988.305008:0:24684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750270080 00000100:00100000:0.0:1787784988.305010:0:24684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750270080 00000100:00100000:0.0:1787784988.305023:0:24684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787784988.305032:0:24684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750269952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784988.305098:0:24684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750269952:12345-0@lo:400:kworker.0 Request processed in 67us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784988.305105:0:24684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787784988.305123:0:24684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784988.305129:0:24684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750269568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784988.305161:0:24684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750269568:12345-0@lo:400:kworker.0 Request processed in 33us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784988.305167:0:24684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784988.305182:0:24684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787784988.305185:0:24684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3643:x1874627750269696:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787784988.305211:0:24684:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 728 last 0 00000020:00000080:0.0:1787784988.305236:0:24684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88ace7295d9eb69 00002000:00100000:0.0:1787784988.305251:0:24684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8950c3533800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113936 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787784988.305265:0:24684:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787784988.305268:0:24684:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787784988.305446:0:24684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787784988.305471:0:24684:0:(import.c:65:import_set_state_nolock()) ffff8950c3537000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784988.305512:0:24684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1874627750269696:12345-0@lo:8:kworker.0 Request processed in 325us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784988.305519:0:24684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787784988.305547:0:24684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787784988.305551:0:24684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3643:x1874627750270080:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787784988.305566:0:24684:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 728 last 0 00000020:00000080:0.0:1787784988.305580:0:24684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x88ace7295d9eb70 00002000:00100000:0.0:1787784988.305586:0:24684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8950c3536000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113936 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1787784988.305589:0:24684:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1787784988.305591:0:24684:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787784988.305613:0:24684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00100000:3.0:1787784988.305818:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750270592 00000100:00100000:3.0:1787784988.305976:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750270592 00000100:00100000:3.0:1787784988.306064:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750270208 00000100:00100000:3.0:1787784988.306068:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750270208 00000100:00100000:3.0:1787784988.306079:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750270720 00000100:00100000:3.0:1787784988.306081:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750270720 00000100:00080000:0.0:1787784988.306194:0:24684:0:(import.c:65:import_set_state_nolock()) ffff8950c3531800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784988.306234:0:24684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3643:x1874627750270080:12345-0@lo:8:kworker.0 Request processed in 681us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784988.306241:0:24684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787784988.309546:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787784988.309556:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784988.310917:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750270336 00000100:00100000:1.0:1787784988.310930:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750270336 00000100:00100000:1.0:1787784988.310987:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750269824 00000100:00100000:1.0:1787784988.310991:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750269824 00000100:00100000:1.0:1787784988.311003:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750270464 00000100:00100000:1.0:1787784988.311005:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750270464 00000100:00100000:1.0:1787784988.311025:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787784988.311035:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750270592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784988.311128:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750270592:12345-0@lo:400:kworker.0 Request processed in 95us (6993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784988.311136:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787784988.311153:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787784988.311159:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750270208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784988.311185:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874627750270208:12345-0@lo:400:kworker.0 Request processed in 28us (6948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784988.311191:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787784988.311203:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787784988.311208:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750270336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784988.311235:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750270336:12345-0@lo:400:kworker.0 Request processed in 27us (6863us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784988.311240:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787784988.311261:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787784988.311267:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750269824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784988.311297:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750269824:12345-0@lo:400:kworker.0 Request processed in 31us (6892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784988.311303:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787784988.311314:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787784988.311319:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750270464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784988.311344:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750270464:12345-0@lo:400:kworker.0 Request processed in 26us (6908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784988.311349:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787784988.311372:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750269440 00000100:00100000:1.0:1787784988.311377:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750269440 00000100:00100000:1.0:1787784988.311405:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787784988.311410:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+24:3646:x1874627750269440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784988.311437:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+24:3646:x1874627750269440:12345-0@lo:400:kworker.0 Request processed in 27us (7245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784988.311441:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1787784988.311468:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787784988.311471:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784988.313506:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fd7c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e11354d-250d-4393-8e0e-7593eb008ce7:3646:1874627750269440:0@lo:400:kworker.0 00010000:00080000:2.0:1787784988.313528:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c12acf00 x1874627750270208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787785004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784988.313551:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874627750270208:0@lo:400:kworker.0 00000100:00100000:2.0:1787784988.313577:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750269952:0@lo:400:kworker.0 00010000:00080000:2.0:1787784988.313593:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c12ade00 x1874627750270592/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787785004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784988.313602:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750270592:0@lo:400:kworker.0 00000100:00100000:3.0:1787784988.315438:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787784988.315455:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750270720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784988.315564:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874627750270720:12345-0@lo:400:kworker.0 Request processed in 114us (11271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784988.315582:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1787784988.315640:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c12ae580 x1874627750270720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787785004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784988.315655:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1874627750270720:0@lo:400:kworker.0 00010000:00080000:3.0:1787784988.315694:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c12ac780 x1874627750269696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787785013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787784988.315719:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787784988.315729:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787784988.315734:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787784988.315738:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8951f67dc000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787784988.315754:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787784988.315760:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1874627750269696:0@lo:8:kworker.0 00010000:00080000:3.0:1787784988.315793:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c12ae940 x1874627750270080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787785013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787784988.315804:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787784988.315810:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787784988.315813:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787784988.315816:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8950c259a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787784988.316830:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787784988.316840:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1874627750270080:0@lo:8:kworker.0 00000004:00080000:3.0:1787784988.316919:0:23417:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787784988.316943:0:23417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53cb840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23417:1874627750270976:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1787784988.316997:0:23417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784988.317024:0:23417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3756a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787784988.317045:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787784988.317054:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750270848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787784988.317081:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784988.317118:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750270848 00000100:00100000:3.0:1787784988.317125:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750270848 00000004:00080000:0.0:1787784988.317193:0:23416:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787784988.317303:0:23416:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 728566533706ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787784988.317310:0:23416:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:2.0:1787784988.318851:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c12ac000 x1874627750269824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787785004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784988.318870:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750269824:0@lo:400:kworker.0 00010000:00080000:2.0:1787784988.318885:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c12aed00 x1874627750270464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787785004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784988.318895:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750270464:0@lo:400:kworker.0 00000100:00100000:2.0:1787784988.318910:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750269568:0@lo:400:kworker.0 00010000:00080000:2.0:1787784988.318922:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c12ad680 x1874627750270336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787785004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784988.318929:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750270336:0@lo:400:kworker.0 00000100:00080000:1.0:1787784988.319104:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1787784988.319168:0:22696:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1787784988.319191:0:22696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22696:1874627750271232:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787784988.319248:0:22696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784988.319281:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fbd6e900 going to sleep for 11 seconds 00000004:00080000:1.0:1787784988.319298:0:22695:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787784988.319377:0:22695:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728568608353ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787784988.319383:0:22695:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1787784988.320018:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750271104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784988.320058:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784988.320201:0:24182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750270976 00000100:00100000:2.0:1787784988.320209:0:24182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750270976 00000100:00100000:2.0:1787784988.320251:0:24182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750271232 00000100:00100000:2.0:1787784988.320254:0:24182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750271232 00000100:00100000:2.0:1787784988.320285:0:24182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787784988.320293:0:24182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:23417:x1874627750270976:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1787784988.320512:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787784988.320520:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff021a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22696:x1874627750271232:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787784988.323295:0:24184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750271104 00000100:00100000:1.0:1787784988.323308:0:24184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750271104 00000100:00100000:1.0:1787784988.323349:0:24184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784988.323360:0:24184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1874627750271104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784988.323394:0:24184:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787784988.323485:0:24184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1874627750271104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (3425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784988.323492:0:24184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787784988.324318:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787784988.324329:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874627750270848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787784988.324344:0:24183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787784988.324391:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1874627750270848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (7309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784988.324398:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787784988.325909:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951d1b5c3c0 x1874627750271104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787785004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784988.325935:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750271104:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787784988.325950:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f53ca1c0 x1874627750270848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787785004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784988.325961:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750270848:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787784988.325998:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1787784988.327013:0:24182:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1787784988.327021:0:24182:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1787784988.327101:0:24182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23417:x1874627750270976:12345-0@lo:7:osp-pre-1-1.0 Request processed in 6806us (10100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784988.327112:0:24182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787784988.327155:0:23417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f53cb840 x1874627750270976/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787785004 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784988.327169:0:23417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53cb840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23417:1874627750270976:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1787784988.327180:0:23417:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1787784988.327230:0:23417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ad680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23417:1874627750271360:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787784988.327266:0:23417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784988.327295:0:23417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c64673c0 going to sleep for 11 seconds 00000004:00080000:2.0:1787784988.328111:0:22650:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1787784988.328322:0:24684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750271360 00000100:00100000:0.0:1787784988.328331:0:24684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750271360 00000100:00100000:0.0:1787784988.328373:0:24684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787784988.328384:0:24684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23417:x1874627750271360:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1787784988.328411:0:24684:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1787784988.328484:0:24684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23417:x1874627750271360:12345-0@lo:5:osp-pre-1-1.0 Request processed in 101us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784988.328491:0:24684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787784988.329925:0:23417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c12ad680 x1874627750271360/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787785004 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784988.329944:0:23417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ad680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23417:1874627750271360:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1787784988.329959:0:23417:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1787784988.330006:0:23417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c9680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23417:1874627750271488:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1787784988.330052:0:23417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784988.330078:0:23417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3756a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784988.330349:0:24181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750271488 00000100:00100000:1.0:1787784988.330356:0:24181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750271488 00000100:00100000:1.0:1787784988.330402:0:24181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787784988.330411:0:24181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23417:x1874627750271488:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787784988.330444:0:24181:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000004:00080000:1.0:1787784988.330938:0:23404:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:2.0:1787784988.339174:0:24179:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1787784988.339197:0:24179:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1787784988.339204:0:24179:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00010000:3.0:1787784988.355835:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784988.355848:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005569c64/0x88ace7295d9eb77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.355866:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1787784988.355872:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784988.355879:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005569c64/0x88ace7295d9eb77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.355910:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005569c64/0x88ace7295d9eb77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.355921:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005569c64/0x88ace7295d9eb77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.355928:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005569c64/0x88ace7295d9eb77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.355951:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784988.356513:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784988.356521:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005569c64/0x88ace7295d9eb77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.356541:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713600 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784988.356546:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005569c64/0x88ace7295d9eb77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.356569:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005569c64/0x88ace7295d9eb77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.356588:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005569c64/0x88ace7295d9eb77 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.356595:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005569c64/0x88ace7295d9eb77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.356629:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784988.356631:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784988.356633:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784988.359339:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787784988.359353:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c782f59/0x88ace7295d9eb7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.359371:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1787784988.359375:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784988.359383:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c782f59/0x88ace7295d9eb7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.359397:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c782f59/0x88ace7295d9eb7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.359408:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c782f59/0x88ace7295d9eb7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.359423:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c782f59/0x88ace7295d9eb7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.359440:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787784988.360561:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787784988.360570:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9eb85 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.360583:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1787784988.360587:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784988.360591:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9eb85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.360602:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9eb85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.360611:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9eb85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.361238:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784988.361248:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c782f59/0x88ace7295d9eb7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.361258:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628400 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784988.361263:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c782f59/0x88ace7295d9eb7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.361271:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c782f59/0x88ace7295d9eb7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.361290:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c782f59/0x88ace7295d9eb7e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.361298:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c782f59/0x88ace7295d9eb7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.361329:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784988.361331:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784988.361333:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784988.362408:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9eb85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.362432:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784988.363228:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784988.363237:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9eb85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.363247:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784988.363252:0:23827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9eb85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.363262:0:23827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9eb85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.363279:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9eb85 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.363287:0:23827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9eb85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.363307:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784988.363309:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784988.363311:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784988.364807:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787784988.364818:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9eb8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.364838:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1787784988.364842:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784988.364849:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9eb8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.364862:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9eb8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.364872:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9eb8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.364880:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9eb8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.364899:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784988.364913:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784988.364918:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9eb8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.364926:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629c00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784988.364930:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9eb8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.364940:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9eb8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.364968:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9eb8c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.364976:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080ea5ee5/0x88ace7295d9eb8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.364996:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784988.364998:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784988.365000:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784988.366575:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784988.367958:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787784988.367971:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a877495/0x88ace7295d9eb93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.367989:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1787784988.367994:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784988.368000:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a877495/0x88ace7295d9eb93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.368013:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a877495/0x88ace7295d9eb93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.368022:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a877495/0x88ace7295d9eb93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.368030:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a877495/0x88ace7295d9eb93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.368109:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787784988.369291:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787784988.369301:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce270c9b/0x88ace7295d9eb9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.369314:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1787784988.369318:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784988.369322:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce270c9b/0x88ace7295d9eb9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.369332:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce270c9b/0x88ace7295d9eb9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.369341:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce270c9b/0x88ace7295d9eb9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.369347:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce270c9b/0x88ace7295d9eb9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.375106:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787784988.375120:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a877495/0x88ace7295d9eb93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.375146:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784988.375150:0:23827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a877495/0x88ace7295d9eb93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.375161:0:23827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a877495/0x88ace7295d9eb93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.375193:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a877495/0x88ace7295d9eb93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.375203:0:23827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a877495/0x88ace7295d9eb93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.376850:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784988.376861:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce270c9b/0x88ace7295d9eb9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.376885:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629e00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784988.376890:0:23827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce270c9b/0x88ace7295d9eb9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.376899:0:23827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce270c9b/0x88ace7295d9eb9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.376917:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce270c9b/0x88ace7295d9eb9a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.376928:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784988.376930:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784988.376932:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784988.377307:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787784988.377316:0:24179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce270c9b/0x88ace7295d9eb9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787784988.377917:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787784988.377925:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f039dd49/0x88ace7295d9eba1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.377944:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1787784988.377949:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784988.377956:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f039dd49/0x88ace7295d9eba1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.377968:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f039dd49/0x88ace7295d9eba1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.377977:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f039dd49/0x88ace7295d9eba1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.377985:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f039dd49/0x88ace7295d9eba1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.378001:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787784988.378213:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784988.378220:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f039dd49/0x88ace7295d9eba1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.378229:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628c00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784988.378233:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f039dd49/0x88ace7295d9eba1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.378242:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f039dd49/0x88ace7295d9eba1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.378255:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f039dd49/0x88ace7295d9eba1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.378270:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f039dd49/0x88ace7295d9eba1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.378287:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784988.378289:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784988.378290:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784988.378298:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784988.378921:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787784988.378930:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9eba8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.378940:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=728s v=(0 0) 00010000:00010000:2.0:1787784988.378944:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784988.378949:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9eba8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.378960:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9eba8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.378983:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9eba8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.378991:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9eba8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.379050:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784988.384196:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784988.384209:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ebaf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.384227:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1787784988.384232:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784988.384239:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ebaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.384255:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ebaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.384276:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ebaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.384284:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ebaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.387378:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784988.387394:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9eba8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.387408:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784988.387413:0:23827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9eba8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.387423:0:23827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9eba8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.387446:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9eba8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.387454:0:23827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c39ab272/0x88ace7295d9eba8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.387474:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784988.387478:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ebaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.387495:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784988.387498:0:23827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ebaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.387506:0:23827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ebaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.387516:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ebaf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.387526:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784988.387528:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784988.387541:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784988.392349:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787784988.392366:0:24179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5e0c0ce/0x88ace7295d9ebaf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787784988.393988:0:24995:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1787784988.394008:0:24995:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1787784988.394012:0:24995:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787784988.394159:0:24181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23417:x1874627750271488:12345-0@lo:5:osp-pre-1-1.0 Request processed in 63744us (64101us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1787784988.394170:0:24181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787784988.394236:0:23417:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1787784988.394244:0:23417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c9680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23417:1874627750271488:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1787784988.394260:0:23417:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:3.0:1787784988.394311:0:23417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c9680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23417:1874627750271616:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1787784988.394346:0:23417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784988.394370:0:23417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fabce6c0 going to sleep for 11 seconds 00002000:00010000:3.0:1787784988.394441:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784988.394450:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9ebb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.394473:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1787784988.394477:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784988.394484:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9ebb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.394496:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9ebb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.394505:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9ebb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.394512:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9ebb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.394539:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784988.395181:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784988.395199:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da0357c/0x88ace7295d9ebbd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.395209:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1787784988.395213:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784988.395218:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009da0357c/0x88ace7295d9ebbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.395228:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009da0357c/0x88ace7295d9ebbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.395247:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da0357c/0x88ace7295d9ebbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.395254:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009da0357c/0x88ace7295d9ebbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.395268:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787784988.395527:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784988.395544:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034b2b2c1/0x88ace7295d9ebc4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.395552:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1787784988.395556:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784988.395560:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034b2b2c1/0x88ace7295d9ebc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.395570:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034b2b2c1/0x88ace7295d9ebc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.395578:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034b2b2c1/0x88ace7295d9ebc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.395586:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034b2b2c1/0x88ace7295d9ebc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.395607:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787784988.396017:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784988.396023:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ba969cd/0x88ace7295d9ebcb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.396033:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1787784988.396036:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784988.396041:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ba969cd/0x88ace7295d9ebcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.396050:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ba969cd/0x88ace7295d9ebcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.396058:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ba969cd/0x88ace7295d9ebcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.396066:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ba969cd/0x88ace7295d9ebcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.396074:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787784988.396356:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784988.396362:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce1844cc/0x88ace7295d9ebd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.396370:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1787784988.396378:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784988.396382:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce1844cc/0x88ace7295d9ebd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.396392:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce1844cc/0x88ace7295d9ebd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.396400:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce1844cc/0x88ace7295d9ebd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.396407:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce1844cc/0x88ace7295d9ebd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.396415:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1787784988.396659:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784988.396665:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e3cbc2e/0x88ace7295d9ebd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.396673:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1787784988.396676:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784988.396680:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e3cbc2e/0x88ace7295d9ebd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.396689:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e3cbc2e/0x88ace7295d9ebd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.396697:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e3cbc2e/0x88ace7295d9ebd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.396841:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e3cbc2e/0x88ace7295d9ebd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.396851:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1787784988.398393:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784988.398404:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa751e68/0x88ace7295d9ebe0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.398419:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1787784988.398423:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784988.398429:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa751e68/0x88ace7295d9ebe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.398441:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa751e68/0x88ace7295d9ebe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.398450:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa751e68/0x88ace7295d9ebe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.398458:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa751e68/0x88ace7295d9ebe0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.398467:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:2.0:1787784988.398969:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750271616 00000100:00100000:2.0:1787784988.398979:0:22680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750271616 00000100:00100000:2.0:1787784988.399039:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784988.399049:0:22680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23417:x1874627750271616:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1787784988.399159:0:22680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23417:x1874627750271616:12345-0@lo:900:osp-pre-1-1.0 Request processed in 112us (4812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784988.399167:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787784988.399199:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1787784988.399206:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9ebb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399216:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713800 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784988.399221:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9ebb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399231:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9ebb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399262:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9ebb6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399269:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dedf7927/0x88ace7295d9ebb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399291:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787784988.399295:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009da0357c/0x88ace7295d9ebbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399301:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712600 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784988.399303:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009da0357c/0x88ace7295d9ebbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399310:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009da0357c/0x88ace7295d9ebbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399318:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009da0357c/0x88ace7295d9ebbd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399324:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009da0357c/0x88ace7295d9ebbd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399334:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787784988.399337:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034b2b2c1/0x88ace7295d9ebc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399347:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712800 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784988.399350:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034b2b2c1/0x88ace7295d9ebc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399357:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034b2b2c1/0x88ace7295d9ebc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399366:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034b2b2c1/0x88ace7295d9ebc4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399373:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034b2b2c1/0x88ace7295d9ebc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399386:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787784988.399389:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ba969cd/0x88ace7295d9ebcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399396:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712000 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784988.399399:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ba969cd/0x88ace7295d9ebcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399406:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ba969cd/0x88ace7295d9ebcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399414:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ba969cd/0x88ace7295d9ebcb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399426:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ba969cd/0x88ace7295d9ebcb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399437:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787784988.399441:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce1844cc/0x88ace7295d9ebd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399447:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712400 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784988.399450:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce1844cc/0x88ace7295d9ebd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399458:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce1844cc/0x88ace7295d9ebd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399466:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce1844cc/0x88ace7295d9ebd2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399473:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce1844cc/0x88ace7295d9ebd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399483:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784988.399486:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e3cbc2e/0x88ace7295d9ebd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399492:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712c00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784988.399498:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e3cbc2e/0x88ace7295d9ebd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399506:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e3cbc2e/0x88ace7295d9ebd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399515:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e3cbc2e/0x88ace7295d9ebd9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399522:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e3cbc2e/0x88ace7295d9ebd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399545:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784988.399549:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa751e68/0x88ace7295d9ebe0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399554:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784988.399556:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa751e68/0x88ace7295d9ebe0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399562:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa751e68/0x88ace7295d9ebe0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399572:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa751e68/0x88ace7295d9ebe0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399580:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa751e68/0x88ace7295d9ebe0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.399599:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784988.399600:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784988.399602:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1787784988.399738:0:23417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f53c9680 x1874627750271616/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787785004 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784988.399765:0:23417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c9680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23417:1874627750271616:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1787784988.400133:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784988.400140:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023e8a2e3/0x88ace7295d9ebe7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.400150:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1787784988.400155:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784988.400160:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023e8a2e3/0x88ace7295d9ebe7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.400171:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023e8a2e3/0x88ace7295d9ebe7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.400191:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023e8a2e3/0x88ace7295d9ebe7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.400199:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023e8a2e3/0x88ace7295d9ebe7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.400219:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784988.400552:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784988.400559:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023e8a2e3/0x88ace7295d9ebe7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.400568:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713e00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784988.400572:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023e8a2e3/0x88ace7295d9ebe7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.400582:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023e8a2e3/0x88ace7295d9ebe7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.400595:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023e8a2e3/0x88ace7295d9ebe7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.400602:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023e8a2e3/0x88ace7295d9ebe7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.400630:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784988.400632:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784988.400634:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784988.400833:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784988.400840:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005569c64/0x88ace7295d9ebee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.400849:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1787784988.400853:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784988.400864:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005569c64/0x88ace7295d9ebee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.400875:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005569c64/0x88ace7295d9ebee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.400884:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005569c64/0x88ace7295d9ebee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.400891:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005569c64/0x88ace7295d9ebee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.400906:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784988.401162:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784988.401167:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005569c64/0x88ace7295d9ebee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.401195:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713600 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784988.401199:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005569c64/0x88ace7295d9ebee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.401208:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005569c64/0x88ace7295d9ebee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.401221:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005569c64/0x88ace7295d9ebee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.401229:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005569c64/0x88ace7295d9ebee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.401244:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784988.401245:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784988.401247:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784988.401365:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784988.401370:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ebf5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.401378:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1787784988.401381:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784988.401385:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ebf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.401393:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ebf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.401400:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ebf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.401417:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ebf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.401437:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784988.401812:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784988.401818:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000113fc6c5/0x88ace7295d9ebfc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.401828:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1787784988.401832:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784988.401836:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000113fc6c5/0x88ace7295d9ebfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.401845:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000113fc6c5/0x88ace7295d9ebfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.401853:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000113fc6c5/0x88ace7295d9ebfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.401861:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000113fc6c5/0x88ace7295d9ebfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.401868:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787784988.402107:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784988.402113:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a43e4949/0x88ace7295d9ec03 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.402126:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1787784988.402129:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784988.402133:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a43e4949/0x88ace7295d9ec03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.402143:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a43e4949/0x88ace7295d9ec03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.402150:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a43e4949/0x88ace7295d9ec03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.402158:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a43e4949/0x88ace7295d9ec03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.402167:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787784988.402380:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787784988.402387:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ebf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.402395:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713400 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784988.402399:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ebf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.402408:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ebf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.402427:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ebf5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.402435:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce5fd0fd/0x88ace7295d9ebf5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.402450:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784988.402453:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000113fc6c5/0x88ace7295d9ebfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.402459:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784988.402462:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000113fc6c5/0x88ace7295d9ebfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.402471:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000113fc6c5/0x88ace7295d9ebfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.402479:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000113fc6c5/0x88ace7295d9ebfc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.402486:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000113fc6c5/0x88ace7295d9ebfc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.402495:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784988.402498:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a43e4949/0x88ace7295d9ec03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.402508:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713c00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784988.402511:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a43e4949/0x88ace7295d9ec03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.402519:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a43e4949/0x88ace7295d9ec03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.402528:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a43e4949/0x88ace7295d9ec03 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.402547:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a43e4949/0x88ace7295d9ec03 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.402559:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784988.402560:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784988.402562:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784988.402842:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784988.402850:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784988.402854:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784988.403121:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784988.403128:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a33132f/0x88ace7295d9ec0a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.403139:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1787784988.403142:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784988.403147:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a33132f/0x88ace7295d9ec0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.403156:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a33132f/0x88ace7295d9ec0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.403178:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a33132f/0x88ace7295d9ec0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.403195:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a33132f/0x88ace7295d9ec0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.403215:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784988.403347:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784988.403353:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a33132f/0x88ace7295d9ec0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.403361:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784988.403365:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a33132f/0x88ace7295d9ec0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.403374:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a33132f/0x88ace7295d9ec0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.403391:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a33132f/0x88ace7295d9ec0a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.403399:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a33132f/0x88ace7295d9ec0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.403414:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784988.403416:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784988.403417:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784988.403610:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784988.403616:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4c987b7/0x88ace7295d9ec11 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.403636:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1787784988.403639:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784988.403643:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4c987b7/0x88ace7295d9ec11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.403653:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4c987b7/0x88ace7295d9ec11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.403660:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4c987b7/0x88ace7295d9ec11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.403668:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4c987b7/0x88ace7295d9ec11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.403696:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787784988.404106:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784988.404113:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4c987b7/0x88ace7295d9ec11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.404120:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713000 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787784988.404124:0:23827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4c987b7/0x88ace7295d9ec11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.404133:0:23827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4c987b7/0x88ace7295d9ec11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.404156:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4c987b7/0x88ace7295d9ec11 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.404164:0:23827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4c987b7/0x88ace7295d9ec11 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784988.404180:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784988.404181:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784988.404192:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784988.404297:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784988.404303:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000494fa2fd/0x88ace7295d9ec18 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.404312:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1787784988.404315:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784988.404320:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000494fa2fd/0x88ace7295d9ec18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.404329:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000494fa2fd/0x88ace7295d9ec18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.404337:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000494fa2fd/0x88ace7295d9ec18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.404345:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000494fa2fd/0x88ace7295d9ec18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.404367:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784988.404605:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784988.404611:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a632fa5/0x88ace7295d9ec1f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.404629:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1787784988.404638:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784988.404642:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a632fa5/0x88ace7295d9ec1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.404652:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a632fa5/0x88ace7295d9ec1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.404660:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a632fa5/0x88ace7295d9ec1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.404668:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a632fa5/0x88ace7295d9ec1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.404788:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787784988.405141:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787784988.405146:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da9e12c/0x88ace7295d9ec26 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.405155:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1787784988.405158:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784988.405162:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009da9e12c/0x88ace7295d9ec26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.405171:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009da9e12c/0x88ace7295d9ec26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.405179:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da9e12c/0x88ace7295d9ec26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.405203:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009da9e12c/0x88ace7295d9ec26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.405244:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787784988.405250:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000494fa2fd/0x88ace7295d9ec18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.405258:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151fa00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784988.405262:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000494fa2fd/0x88ace7295d9ec18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.405270:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000494fa2fd/0x88ace7295d9ec18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.405283:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000494fa2fd/0x88ace7295d9ec18 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.405291:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000494fa2fd/0x88ace7295d9ec18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.405319:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784988.405322:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a632fa5/0x88ace7295d9ec1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.405328:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151f200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784988.405331:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a632fa5/0x88ace7295d9ec1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.405339:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a632fa5/0x88ace7295d9ec1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.405349:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a632fa5/0x88ace7295d9ec1f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.405356:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a632fa5/0x88ace7295d9ec1f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.405367:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784988.405371:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009da9e12c/0x88ace7295d9ec26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.405377:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151e200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784988.405380:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009da9e12c/0x88ace7295d9ec26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.405399:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009da9e12c/0x88ace7295d9ec26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.405410:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009da9e12c/0x88ace7295d9ec26 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.405419:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784988.405420:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784988.405422:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784988.405690:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784988.406851:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787784988.406861:0:24179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009da9e12c/0x88ace7295d9ec26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787784988.409017:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784988.409030:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060b7c8c7/0x88ace7295d9ec2d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.409049:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1787784988.409053:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784988.409060:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060b7c8c7/0x88ace7295d9ec2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.409075:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060b7c8c7/0x88ace7295d9ec2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.409086:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060b7c8c7/0x88ace7295d9ec2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.409094:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060b7c8c7/0x88ace7295d9ec2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.409855:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784988.409865:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060b7c8c7/0x88ace7295d9ec2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.409875:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951fda13c00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:2.0:1787784988.409880:0:23827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060b7c8c7/0x88ace7295d9ec2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.409890:0:23827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060b7c8c7/0x88ace7295d9ec2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.409907:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060b7c8c7/0x88ace7295d9ec2d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784988.409917:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784988.409919:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784988.409920:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784988.411245:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787784988.411257:0:24179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060b7c8c7/0x88ace7295d9ec2d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787784988.411907:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784988.411915:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da411d45/0x88ace7295d9ec34 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.411934:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1787784988.411939:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784988.411946:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da411d45/0x88ace7295d9ec34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.411960:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da411d45/0x88ace7295d9ec34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.411969:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da411d45/0x88ace7295d9ec34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.411976:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da411d45/0x88ace7295d9ec34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.412001:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784988.412397:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784988.412404:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da411d45/0x88ace7295d9ec34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.412414:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951fda12200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784988.412418:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da411d45/0x88ace7295d9ec34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.412427:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da411d45/0x88ace7295d9ec34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.412444:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da411d45/0x88ace7295d9ec34 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.412451:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da411d45/0x88ace7295d9ec34 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.412467:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784988.412474:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784988.412476:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784988.412564:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784988.412570:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000973b0673/0x88ace7295d9ec3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.412578:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1787784988.412582:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784988.412586:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000973b0673/0x88ace7295d9ec3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.412596:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000973b0673/0x88ace7295d9ec3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.412613:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000973b0673/0x88ace7295d9ec3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.412630:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000973b0673/0x88ace7295d9ec3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.412649:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784988.412945:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784988.412952:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000973b0673/0x88ace7295d9ec3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.412960:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951fda12c00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784988.412964:0:23827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000973b0673/0x88ace7295d9ec3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.412972:0:23827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000973b0673/0x88ace7295d9ec3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.412983:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000973b0673/0x88ace7295d9ec3b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.412990:0:23827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000973b0673/0x88ace7295d9ec3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.413001:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784988.413003:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784988.413005:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784988.413101:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784988.413106:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b1cf4e1/0x88ace7295d9ec42 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.413114:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1787784988.413118:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784988.413122:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b1cf4e1/0x88ace7295d9ec42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.413131:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b1cf4e1/0x88ace7295d9ec42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.413139:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b1cf4e1/0x88ace7295d9ec42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.413146:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b1cf4e1/0x88ace7295d9ec42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.413175:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784988.413405:0:22659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784988.413410:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b1cf4e1/0x88ace7295d9ec42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.413417:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951fda13600 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784988.413421:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b1cf4e1/0x88ace7295d9ec42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.413435:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b1cf4e1/0x88ace7295d9ec42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.413446:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b1cf4e1/0x88ace7295d9ec42 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.413454:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b1cf4e1/0x88ace7295d9ec42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.413468:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784988.413469:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784988.413471:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784988.413601:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787784988.413607:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8287253/0x88ace7295d9ec49 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.413626:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=728s v=(0 0) 00010000:00010000:0.0:1787784988.413629:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784988.413634:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8287253/0x88ace7295d9ec49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.413644:0:24179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8287253/0x88ace7295d9ec49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.413651:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8287253/0x88ace7295d9ec49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.413658:0:24179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8287253/0x88ace7295d9ec49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784988.413674:0:24179:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787784988.413701:0:24179:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:0.0:1787784988.413821:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff021a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22696:x1874627750271232:12345-0@lo:5:osp-pre-1-0.0 Request processed in 93298us (94569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784988.413830:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1787784988.413945:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784988.413951:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8287253/0x88ace7295d9ec49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.413959:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951fda13200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:3.0:1787784988.413963:0:23827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8287253/0x88ace7295d9ec49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.413971:0:23827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8287253/0x88ace7295d9ec49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.413983:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8287253/0x88ace7295d9ec49 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.414001:0:23827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8287253/0x88ace7295d9ec49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784988.414015:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784988.414016:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784988.414018:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784988.414308:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784988.414342:0:22696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22696:1874627750271232:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787784988.414357:0:22696:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1787784988.414395:0:22696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff0212c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22696:1874627750271744:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787784988.414428:0:22696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784988.414698:0:22696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951fbd6e900 going to sleep for 11 seconds 00000100:00100000:3.0:1787784988.417978:0:24684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750271744 00000100:00100000:3.0:1787784988.417994:0:24684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750271744 00000100:00100000:3.0:1787784988.418055:0:24684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787784988.418064:0:24684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22696:x1874627750271744:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787784988.418114:0:24684:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:3.0:1787784988.421920:0:24684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22696:x1874627750271744:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3850us (7484us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1787784988.421934:0:24684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787784988.422063:0:22696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff0212c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22696:1874627750271744:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787784988.422079:0:22696:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000040:00080000:3.0:1787784988.806664:0:22705:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787784989.386630:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787784990.195724:0:25350:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787784990.406868:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787784991.188089:0:25402:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787784991.188470:0:25402:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787784991.432795:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787784992.001354:0:25452:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787784992.001693:0:25452:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787784992.377935:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784992.378037:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728133504 00000100:00100000:3.0:1787784992.378050:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728133504 00000100:00100000:3.0:1787784992.378101:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 114 00000100:00100000:3.0:1787784992.378110:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2404:x1874627728133504:12345-192.168.202.41@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787784992.378141:0:22662:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1c1bb492-200e-444d-8679-4c80592d7d80@192.168.202.41@tcp t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:3.0:1787784992.378176:0:22662:0:(genops.c:1385:class_connect()) connect: client 1c1bb492-200e-444d-8679-4c80592d7d80, cookie 0x88ace7295d9ec50 00000100:00080000:3.0:1787784992.378322:0:22662:0:(import.c:65:import_set_state_nolock()) ffff8951c4560000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787784992.378481:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1bb492-200e-444d-8679-4c80592d7d80+5:2404:x1874627728133504:12345-192.168.202.41@tcp:250:mount.lustre.0 Request processed in 369us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784992.378489:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 114 00000100:00100000:2.0:1787784992.390084:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784992.390108:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750271872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787784992.390192:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784992.390270:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750271872 00000100:00100000:2.0:1787784992.390278:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750271872 00000100:00100000:2.0:1787784992.390334:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787784992.390344:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750271872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787784992.390656:0:24183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787784992.390712:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750271872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 370us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784992.390720:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1787784992.390742:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784992.390829:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750271872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787784992.390992:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750272000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784992.391023:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784992.391121:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750272000 00000100:00100000:3.0:1787784992.391126:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750272000 00000100:00100000:3.0:1787784992.391172:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787784992.391180:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff023840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750272000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784992.391191:0:24183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787784992.391222:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff023840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750272000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784992.391228:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787784992.391331:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784992.391353:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750272000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784992.395082:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784992.395293:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728133632 00000100:00100000:1.0:1787784992.395302:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728133632 00000100:00100000:1.0:1787784992.395359:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 115 00000100:00100000:1.0:1787784992.395449:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff08bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+5:18063:x1874627728133632:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787784992.395465:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784992.395483:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df602e00/0x88ace7295d9ec57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72f5c expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784992.395519:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df602e00/0x88ace7295d9ec57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f5c expref: 6 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784992.395530:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df602e00/0x88ace7295d9ec57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f5c expref: 6 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784992.395539:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602e00, rc 0) 00000100:00100000:1.0:1787784992.399475:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff08bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+6:18063:x1874627728133632:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 4095us (4389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784992.399488:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 115 00000100:00100000:2.0:1787784992.424019:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784992.427257:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728133760 00000100:00100000:1.0:1787784992.427274:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728133760 00000100:00100000:1.0:1787784992.427510:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 116 00000100:00100000:1.0:1787784992.427520:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff08a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1bb492-200e-444d-8679-4c80592d7d80+6:18063:x1874627728133760:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787784992.427676:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff08a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1bb492-200e-444d-8679-4c80592d7d80+6:18063:x1874627728133760:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 148us (3659us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787784992.427684:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 116 00000100:00100000:2.0:1787784992.434741:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784992.434878:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728133888 00000100:00100000:0.0:1787784992.434904:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728133888 00000100:00100000:0.0:1787784992.434953:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 117 00000100:00100000:0.0:1787784992.434964:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff08b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+6:18063:x1874627728133888:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787784992.434979:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784992.434997:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951fda13c00/0x88ace7295d9ec5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72f63 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784992.435026:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951fda13c00/0x88ace7295d9ec5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f63 expref: 7 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784992.435037:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951fda13c00/0x88ace7295d9ec5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f63 expref: 7 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784992.435046:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951fda13c00, rc 0) 00000100:00100000:0.0:1787784992.435108:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff08b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+7:18063:x1874627728133888:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 146us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784992.435116:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 117 00000100:00100000:2.0:1787784992.450871:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784992.450979:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728134016 00000100:00100000:0.0:1787784992.450989:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728134016 00000100:00100000:0.0:1787784992.451042:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 118 00000100:00100000:0.0:1787784992.451052:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+7:18063:x1874627728134016:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787784992.452240:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff088850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+8:18063:x1874627728134016:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 1182us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784992.452253:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 118 00010000:00010000:3.0:1787784992.456015:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784992.465050:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784992.465170:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728134144 00000100:00100000:1.0:1787784992.465181:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728134144 00000100:00100000:1.0:1787784992.465241:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 119 00000100:00100000:1.0:1787784992.465252:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1bb492-200e-444d-8679-4c80592d7d80+8:18063:x1874627728134144:12345-192.168.202.41@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787784992.465550:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1bb492-200e-444d-8679-4c80592d7d80+8:18063:x1874627728134144:12345-192.168.202.41@tcp:503:mount.lustre.0 Request processed in 299us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784992.465559:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 119 00000100:00100000:2.0:1787784992.474639:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784992.474746:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728134272 00000100:00100000:0.0:1787784992.474756:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728134272 00000100:00100000:0.0:1787784992.474845:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 120 00000100:00100000:0.0:1787784992.474855:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff08a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+8:18082:x1874627728134272:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787784992.474999:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff08a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+8:18082:x1874627728134272:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 145us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784992.475007:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 120 00000100:00100000:2.0:1787784992.521598:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784992.521716:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728134400 00000100:00100000:1.0:1787784992.521726:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728134400 00000100:00100000:0.0:1787784992.521871:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 121 00000100:00100000:0.0:1787784992.521883:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff08a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+8:18082:x1874627728134400:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787784992.522040:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff08a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+8:18082:x1874627728134400:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 159us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784992.522048:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 121 00000100:00100000:2.0:1787784992.545718:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784992.546047:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728134528 00000100:00100000:3.0:1787784992.546061:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728134528 00000100:00100000:3.0:1787784992.546142:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 122 00000100:00100000:3.0:1787784992.546165:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1bb492-200e-444d-8679-4c80592d7d80+8:18082:x1874627728134528:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787784992.546504:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1bb492-200e-444d-8679-4c80592d7d80+8:18082:x1874627728134528:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 333us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784992.546514:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 122 00000100:00100000:2.0:1787784992.557106:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784992.557690:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728134656 00000100:00100000:1.0:1787784992.557705:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728134656 00000100:00100000:1.0:1787784992.557807:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 123 00000100:00100000:1.0:1787784992.557819:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff08ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1bb492-200e-444d-8679-4c80592d7d80+8:18063:x1874627728134656:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787784992.557841:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784992.557867:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df603e00/0x88ace7295d9ec65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72f94 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784992.557911:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df603e00/0x88ace7295d9ec65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f94 expref: 9 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784992.557924:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df603e00/0x88ace7295d9ec65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f94 expref: 9 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784992.557935:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603e00, rc 0) 00000100:00100000:1.0:1787784992.558075:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff08ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1bb492-200e-444d-8679-4c80592d7d80+9:18063:x1874627728134656:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 258us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784992.558084:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 123 00000100:00100000:2.0:1787784992.572725:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784992.572884:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728134784 00000100:00100000:0.0:1787784992.572901:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728134784 00000100:00100000:0.0:1787784992.572985:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 124 00000100:00100000:0.0:1787784992.573000:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+9:18063:x1874627728134784:12345-192.168.202.41@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787784992.573041:0:22663:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787784992.573080:0:22663:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787784992.573085:0:22663:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787784992.573088:0:22663:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787784992.573091:0:22663:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787784992.573094:0:22663:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1787784992.575707:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff08b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+9:18063:x1874627728134784:12345-192.168.202.41@tcp:256:mount.lustre.0 Request processed in 2691us (2978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784992.575729:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 124 00000100:00100000:2.0:1787784992.581618:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784992.582045:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728134912 00000100:00100000:3.0:1787784992.582062:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728134912 00000100:00100000:3.0:1787784992.582140:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 125 00000100:00100000:3.0:1787784992.582160:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1bb492-200e-444d-8679-4c80592d7d80+9:18063:x1874627728134912:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787784992.582185:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784992.582215:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c151f600/0x88ace7295d9ec6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72f9b expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784992.582295:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c151f600/0x88ace7295d9ec6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f9b expref: 10 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784992.582310:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c151f600/0x88ace7295d9ec6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f9b expref: 10 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784992.582321:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c151f600, rc 0) 00000100:00100000:3.0:1787784992.582414:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1bb492-200e-444d-8679-4c80592d7d80+10:18063:x1874627728134912:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 255us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784992.582424:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 125 00000100:00100000:2.0:1787784992.585634:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784992.586073:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728135040 00000100:00100000:0.0:1787784992.586087:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728135040 00000100:00100000:0.0:1787784992.586169:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 126 00000100:00100000:0.0:1787784992.586182:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+10:18063:x1874627728135040:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787784992.586440:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff088050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+10:18063:x1874627728135040:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 259us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784992.586450:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 126 00000100:00100000:2.0:1787784992.589101:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784992.589277:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728135168 00000100:00100000:1.0:1787784992.589306:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728135168 00000100:00100000:1.0:1787784992.589383:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 127 00000100:00100000:1.0:1787784992.589397:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1bb492-200e-444d-8679-4c80592d7d80+10:18063:x1874627728135168:12345-192.168.202.41@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787784992.589607:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1bb492-200e-444d-8679-4c80592d7d80+10:18063:x1874627728135168:12345-192.168.202.41@tcp:503:mount.lustre.0 Request processed in 212us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784992.589617:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 127 00000100:00100000:2.0:1787784992.592840:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784992.593540:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728135296 00000100:00100000:3.0:1787784992.593554:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728135296 00000100:00100000:3.0:1787784992.593631:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 128 00000100:00100000:3.0:1787784992.593642:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1bb492-200e-444d-8679-4c80592d7d80+10:18089:x1874627728135296:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787784992.593907:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1bb492-200e-444d-8679-4c80592d7d80+10:18089:x1874627728135296:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 265us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784992.593916:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 128 00000100:00100000:2.0:1787784992.596742:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784992.596887:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728135424 00000100:00100000:0.0:1787784992.596902:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728135424 00000100:00100000:0.0:1787784992.597006:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 129 00000100:00100000:0.0:1787784992.597019:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+10:18089:x1874627728135424:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787784992.597237:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+10:18089:x1874627728135424:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 219us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784992.597246:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 129 00000100:00100000:2.0:1787784992.609312:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784992.609513:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728135552 00000100:00100000:1.0:1787784992.609527:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728135552 00000100:00100000:1.0:1787784992.609589:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:1.0:1787784992.609602:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2404:x1874627728135552:12345-192.168.202.41@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787784992.609644:0:22670:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3afbc3a9-7189-4bc3-a69b-cd7ebe093899@192.168.202.41@tcp t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:1.0:1787784992.609711:0:22670:0:(genops.c:1385:class_connect()) connect: client 3afbc3a9-7189-4bc3-a69b-cd7ebe093899, cookie 0x88ace7295d9ec73 00000004:00100000:1.0:1787784992.609747:0:22670:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787784992.610062:0:22670:0:(import.c:65:import_set_state_nolock()) ffff8950c4368800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784992.610167:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:2404:x1874627728135552:12345-192.168.202.41@tcp:38:mount.lustre.0 Request processed in 565us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784992.610175:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:2.0:1787784992.616109:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784992.616262:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728135808 00000100:00100000:0.0:1787784992.616277:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728135808 00000100:00100000:0.0:1787784992.616341:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:0.0:1787784992.616353:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2404:x1874627728135808:12345-192.168.202.41@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787784992.616405:0:22671:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 3afbc3a9-7189-4bc3-a69b-cd7ebe093899@192.168.202.41@tcp t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:0.0:1787784992.616479:0:22671:0:(genops.c:1385:class_connect()) connect: client 3afbc3a9-7189-4bc3-a69b-cd7ebe093899, cookie 0x88ace7295d9ec7a 00000004:00100000:0.0:1787784992.616525:0:22671:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787784992.616861:0:22671:0:(import.c:65:import_set_state_nolock()) ffff8950c3532000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784992.616960:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:2404:x1874627728135808:12345-192.168.202.41@tcp:38:mount.lustre.0 Request processed in 607us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784992.616968:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:3.0:1787784992.624006:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784992.624809:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784992.624851:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784992.624976:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728136064 00000100:00100000:3.0:1787784992.624991:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728136064 00000100:00100000:3.0:1787784992.625069:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728135936 00000100:00100000:3.0:1787784992.625072:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728135936 00000100:00100000:3.0:1787784992.625091:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728135680 00000100:00100000:3.0:1787784992.625094:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728135680 00000100:00100000:3.0:1787784992.625112:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:3.0:1787784992.625123:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+7:18063:x1874627728136064:12345-192.168.202.41@tcp:41:mount.lustre.0 00000100:00080000:1.0:1787784992.625219:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787784992.625224:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1787784992.625308:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787784992.625546:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+7:18063:x1874627728136064:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 422us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784992.625554:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:3.0:1787784992.625580:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:3.0:1787784992.625588:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:0:x1874627728135936:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787784992.625607:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787784992.625656:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:0:x1874627728135936:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 69us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784992.625663:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:3.0:1787784992.625677:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:3.0:1787784992.625684:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:0:x1874627728135680:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787784992.625694:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787784992.625717:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:0:x1874627728135680:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 33us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784992.625724:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:3.0:1787784992.634891:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784992.635236:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728136192 00000100:00100000:2.0:1787784992.635250:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728136192 00000100:00100000:2.0:1787784992.635615:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:2.0:1787784992.635630:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:18063:x1874627728136192:12345-192.168.202.41@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787784992.635758:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:18063:x1874627728136192:12345-192.168.202.41@tcp:40:mount.lustre.0 Request processed in 131us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784992.635800:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:1.0:1787784992.638050:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784992.638450:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728136576 00000100:00100000:3.0:1787784992.638463:0:22680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728136576 00000100:00100000:3.0:1787784992.638583:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:3.0:1787784992.638595:0:22680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff021e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:18063:x1874627728136576:12345-192.168.202.41@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787784992.638712:0:22680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff021e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:18063:x1874627728136576:12345-192.168.202.41@tcp:900:mount.lustre.0 Request processed in 119us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784992.638722:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:1.0:1787784992.641751:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784992.641900:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784992.641935:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784992.642029:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728136320 00000100:00100000:0.0:1787784992.642043:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728136320 00000100:00100000:0.0:1787784992.642095:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728136448 00000100:00100000:0.0:1787784992.642099:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728136448 00000100:00100000:0.0:1787784992.642156:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:0.0:1787784992.642167:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2404:x1874627728136320:12345-192.168.202.41@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787784992.642214:0:24179:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3afbc3a9-7189-4bc3-a69b-cd7ebe093899@192.168.202.41@tcp t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:0.0:1787784992.642266:0:24179:0:(genops.c:1385:class_connect()) connect: client 3afbc3a9-7189-4bc3-a69b-cd7ebe093899, cookie 0x88ace7295d9ec81 00002000:00100000:0.0:1787784992.642282:0:24179:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3afbc3a9-7189-4bc3-a69b-cd7ebe093899/ffff8950c3530800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787784992.642298:0:24179:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787784992.642602:0:24179:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787784992.642646:0:24179:0:(import.c:65:import_set_state_nolock()) ffff8950c3536800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784992.642741:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:2404:x1874627728136320:12345-192.168.202.41@tcp:8:mount.lustre.0 Request processed in 574us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784992.642750:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:0.0:1787784992.642814:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:0.0:1787784992.642819:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2404:x1874627728136448:12345-192.168.202.41@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787784992.642839:0:24179:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3afbc3a9-7189-4bc3-a69b-cd7ebe093899@192.168.202.41@tcp t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:0.0:1787784992.642859:0:24179:0:(genops.c:1385:class_connect()) connect: client 3afbc3a9-7189-4bc3-a69b-cd7ebe093899, cookie 0x88ace7295d9ec88 00002000:00100000:0.0:1787784992.642867:0:24179:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3afbc3a9-7189-4bc3-a69b-cd7ebe093899/ffff8950c3530000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787784992.642884:0:24179:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787784992.643032:0:24179:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787784992.643052:0:24179:0:(import.c:65:import_set_state_nolock()) ffff8950c3533000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784992.643080:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:2404:x1874627728136448:12345-192.168.202.41@tcp:8:mount.lustre.0 Request processed in 259us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784992.643087:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:2.0:1787784992.644564:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728136704 00000100:00100000:2.0:1787784992.644581:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728136704 00000100:00100000:2.0:1787784992.644710:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:2.0:1787784992.644722:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d1b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:18063:x1874627728136704:12345-192.168.202.41@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787784992.651892:0:22672:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 7028us 00000004:00200000:2.0:1787784992.679438:0:22672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787784992.681345:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d1b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:18063:x1874627728136704:12345-192.168.202.41@tcp:33:mount.lustre.0 Request processed in 36606us (39593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784992.681363:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:2.0:1787784992.902080:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750272128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784992.902190:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784992.902429:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750272128 00000100:00100000:3.0:1787784992.902440:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750272128 00000100:00100000:3.0:1787784992.902516:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787784992.902528:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750272128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787784992.902577:0:22674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787784992.902653:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750272128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784992.902662:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787784992.902723:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750272128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787784992.902974:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784992.902985:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750272256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784992.903021:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784992.903258:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750272256 00000100:00100000:0.0:1787784992.903265:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750272256 00000100:00100000:0.0:1787784992.903327:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787784992.903337:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750272256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787784992.903363:0:23412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787784992.903412:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750272256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784992.903420:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787784992.903451:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750272256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787784992.904166:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784992.904582:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728136832 00000100:00100000:0.0:1787784992.904591:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728136832 00000100:00100000:0.0:1787784992.904647:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:0.0:1787784992.904658:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:18112:x1874627728136832:12345-192.168.202.41@tcp:101:mkdir.0 00010000:00010000:0.0:1787784992.904675:0:22671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784992.904710:0:22671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13200/0x88ace7295d9ec8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72fcc expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784992.905960:0:22671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13600/0x88ace7295d9ec96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784992.905985:0:22671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13600/0x88ace7295d9ec96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784992.906009:0:22671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13600/0x88ace7295d9ec96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784992.906078:0:22671:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787784992.906083:0:22671:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787784992.906135:0:22671:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13600/0x88ace7295d9ec96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784992.906207:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13200/0x88ace7295d9ec8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72fcc expref: 8 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784992.906233:0:22671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13600/0x88ace7295d9ec96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72fcc expref: 7 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784992.906242:0:22671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128900) 00010000:00010000:0.0:1787784992.906245:0:22671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784992.906249:0:22671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951fda13600, rc 0) 00000100:00100000:0.0:1787784992.906464:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+7:18112:x1874627728136832:12345-192.168.202.41@tcp:101:mkdir.0 Request processed in 1806us (2301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784992.906474:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:1.0:1787784993.416394:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750272384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784993.416525:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784993.416737:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e11354d-250d-4393-8e0e-7593eb008ce7:3647:1874627750272512:0@lo:400:kworker.0 00000100:00100000:0.0:1787784993.416810:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784993.416825:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951efef2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750272640:0@lo:400:kworker.0 00000100:00100000:1.0:1787784993.416862:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784993.416886:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750272640 00000100:00100000:0.0:1787784993.416896:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750272640 00000100:00100000:1.0:1787784993.416898:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750272512 00000100:00100000:1.0:1787784993.416901:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750272512 00000100:00100000:1.0:1787784993.416952:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787784993.416957:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784993.416964:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+24:3647:x1874627750272512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784993.416964:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750272640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784993.417022:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+24:3647:x1874627750272512:12345-0@lo:400:kworker.0 Request processed in 59us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784993.417022:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750272640:12345-0@lo:400:kworker.0 Request processed in 58us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784993.417032:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787784993.417032:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784993.417073:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e11354d-250d-4393-8e0e-7593eb008ce7:3647:1874627750272512:0@lo:400:kworker.0 00000100:00100000:1.0:1787784993.417074:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951efef2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750272640:0@lo:400:kworker.0 00000100:00100000:0.0:1787784993.417120:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750272768:0@lo:400:kworker.0 00000100:00100000:0.0:1787784993.417150:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784993.417397:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784993.417408:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750272896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787784993.417439:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784993.418153:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750273152:0@lo:400:kworker.0 00000100:00100000:3.0:1787784993.418369:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750273024:0@lo:400:kworker.0 00000100:00100000:3.0:1787784993.418415:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784993.418462:0:24181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750273024 00000100:00100000:3.0:1787784993.418471:0:24181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750273024 00000100:00100000:3.0:1787784993.418525:0:24181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787784993.418534:0:24181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53ca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750273024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784993.418581:0:24181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53ca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750273024:12345-0@lo:400:kworker.0 Request processed in 49us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784993.418588:0:24181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787784993.418630:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750273024:0@lo:400:kworker.0 00000100:00100000:3.0:1787784993.418693:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784993.418700:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750273408:0@lo:400:kworker.0 00000100:00100000:3.0:1787784993.418726:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784993.418752:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750272768 00000100:00100000:3.0:1787784993.418791:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750272768 00000100:00100000:3.0:1787784993.418820:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750273408 00000100:00100000:3.0:1787784993.418823:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750273408 00000100:00100000:3.0:1787784993.418867:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787784993.418886:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3272940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750272768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784993.418922:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3272940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750272768:12345-0@lo:400:kworker.0 Request processed in 49us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784993.418929:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787784993.418942:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787784993.418948:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750273408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784993.419067:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874627750273408:12345-0@lo:400:kworker.0 Request processed in 119us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784993.419074:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1787784993.419103:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f53c92c0 x1874627750273408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787785009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784993.419307:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750272384 00000100:00100000:2.0:1787784993.419320:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750272384 00000100:00100000:2.0:1787784993.419349:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750272896 00000100:00100000:2.0:1787784993.419353:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750272896 00000100:00100000:2.0:1787784993.419371:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787784993.419378:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874627750272384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787784993.419400:0:24183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787784993.419443:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1874627750272384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (2920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784993.419451:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787784993.419464:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787784993.419471:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750272896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787784993.419482:0:24183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787784993.419519:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750272896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (2079us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784993.419525:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787784993.419731:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750273280:0@lo:400:kworker.0 00000100:00100000:2.0:1787784993.419803:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784993.419854:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750272768:0@lo:400:kworker.0 00000100:00100000:2.0:1787784993.419872:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787784993.419878:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750273664:0@lo:400:kworker.0 00000100:00100000:2.0:1787784993.419908:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784993.419933:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750273280 00000100:00100000:2.0:1787784993.419937:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750273280 00000100:00100000:0.0:1787784993.420363:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750272384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784993.420404:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784993.420411:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750273536:0@lo:400:kworker.0 00000100:00100000:3.0:1787784993.420739:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1874627750273408:0@lo:400:kworker.0 00000100:00100000:3.0:1787784993.420781:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750272896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787784993.420891:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750273664 00000100:00100000:2.0:1787784993.420896:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750273664 00000100:00100000:2.0:1787784993.420924:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787784993.420933:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750273280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784993.421354:0:22670:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787784993.421365:0:22670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787784993.421832:0:22671:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787784993.421846:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787784993.421857:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750273664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784993.421988:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787784993.422038:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784993.422045:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787784993.422049:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787784993.430757:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784993.431823:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750273536 00000100:00100000:0.0:1787784993.431837:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750273536 00000100:00100000:3.0:1787784993.431947:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750273664:12345-0@lo:400:kworker.0 Request processed in 10088us (12034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784993.431959:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787784993.431980:0:22671:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787784993.432004:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750273152 00000100:00100000:3.0:1787784993.432007:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750273152 00000100:00100000:3.0:1787784993.432022:0:22671:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787784993.432028:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787784993.432034:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3270b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750273536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784993.432092:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3270b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750273536:12345-0@lo:400:kworker.0 Request processed in 59us (10107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784993.432097:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787784993.432104:0:22671:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787784993.432107:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787784993.432111:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750273152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784993.432132:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750273152:12345-0@lo:400:kworker.0 Request processed in 20us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784993.432137:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787784993.432514:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750273280:12345-0@lo:400:kworker.0 Request processed in 11580us (12743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784993.432520:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1787784993.432552:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787784993.432603:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951c12aed00 x1874627750273664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787785009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784993.432618:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750273664:0@lo:400:kworker.0 00000100:00100000:3.0:1787784993.432635:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750273280:0@lo:400:kworker.0 00000100:00100000:3.0:1787784993.432721:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750273536:0@lo:400:kworker.0 00000100:00100000:1.0:1787784993.435612:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750273152:0@lo:400:kworker.0 00010000:00010000:3.0:1787784993.479032:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787784993.862930:0:23428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1787784993.935963:0:24995:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3afbc3a9-7189-4bc3-a69b-cd7ebe093899 00000001:00080000:3.0:1787784993.935986:0:24995:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:1.0:1787784994.502005:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784995.102034:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784995.102195:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728136960 00000100:00100000:3.0:1787784995.102211:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728136960 00000100:00100000:3.0:1787784995.102352:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:3.0:1787784995.102366:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+7:18165:x1874627728136960:12345-192.168.202.41@tcp:41:lfs.0 00000004:00000024:3.0:1787784995.102440:0:22671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787784995.102580:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+7:18165:x1874627728136960:12345-192.168.202.41@tcp:41:lfs.0 Request processed in 216us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784995.102589:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00080000:2.0:1787784995.103252:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784995.108566:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784995.108725:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728137088 00000100:00100000:0.0:1787784995.108739:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728137088 00000100:00100000:0.0:1787784995.108881:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:0.0:1787784995.108893:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:18165:x1874627728137088:12345-192.168.202.41@tcp:41:lfs.0 00000004:00000024:0.0:1787784995.108941:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787784995.109055:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:18165:x1874627728137088:12345-192.168.202.41@tcp:41:lfs.0 Request processed in 165us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784995.109063:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00080000:2.0:1787784995.109350:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787784995.112870:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784995.113027:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728137216 00000100:00100000:2.0:1787784995.113039:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728137216 00000100:00100000:2.0:1787784995.113138:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:2.0:1787784995.113152:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:18165:x1874627728137216:12345-192.168.202.41@tcp:13:lfs.0 00002000:00000024:2.0:1787784995.113201:0:24183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787784995.113357:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:18165:x1874627728137216:12345-192.168.202.41@tcp:13:lfs.0 Request processed in 208us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784995.113366:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00080000:0.0:1787784995.113809:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784995.116995:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784995.117185:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728137344 00000100:00100000:2.0:1787784995.117198:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728137344 00000100:00100000:2.0:1787784995.117300:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:2.0:1787784995.117314:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+5:18165:x1874627728137344:12345-192.168.202.41@tcp:13:lfs.0 00002000:00000024:2.0:1787784995.117373:0:24183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787784995.117513:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+5:18165:x1874627728137344:12345-192.168.202.41@tcp:13:lfs.0 Request processed in 201us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784995.117522:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00080000:0.0:1787784995.118573:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784995.375944:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784995.376065:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728137472 00000100:00100000:0.0:1787784995.376080:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728137472 00000100:00100000:0.0:1787784995.376171:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 131 00000100:00100000:0.0:1787784995.376183:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+10:18199:x1874627728137472:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787784995.376208:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784995.376234:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951fda13200/0x88ace7295d9ec9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e72fd3 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784995.376286:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951fda13200/0x88ace7295d9ec9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72fd3 expref: 11 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784995.376318:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951fda13200/0x88ace7295d9ec9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72fd3 expref: 11 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784995.376331:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951fda13200, rc 0) 00000100:00100000:0.0:1787784995.376418:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+11:18199:x1874627728137472:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 236us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784995.376427:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 131 00000100:00100000:1.0:1787784995.378352:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784995.378495:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728137600 00000100:00100000:3.0:1787784995.378507:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728137600 00000100:00100000:3.0:1787784995.378573:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 132 00000100:00100000:3.0:1787784995.378585:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1bb492-200e-444d-8679-4c80592d7d80+11:18199:x1874627728137600:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787784995.378838:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1bb492-200e-444d-8679-4c80592d7d80+11:18199:x1874627728137600:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 254us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784995.378848:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 132 00000100:00100000:3.0:1787784995.380567:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784995.382569:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728137728 00000100:00100000:0.0:1787784995.382593:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728137728 00000100:00100000:0.0:1787784995.382694:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 133 00000100:00100000:0.0:1787784995.382707:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+11:18199:x1874627728137728:12345-192.168.202.41@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787784995.384320:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+11:18199:x1874627728137728:12345-192.168.202.41@tcp:503:mount.lustre.0 Request processed in 1599us (3750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784995.384347:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 133 00000100:00100000:1.0:1787784995.405360:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784995.405839:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728137856 00000100:00100000:2.0:1787784995.405853:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728137856 00000100:00100000:2.0:1787784995.405923:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 134 00000100:00100000:2.0:1787784995.405937:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1bb492-200e-444d-8679-4c80592d7d80+11:18205:x1874627728137856:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787784995.406173:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1bb492-200e-444d-8679-4c80592d7d80+11:18205:x1874627728137856:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 239us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784995.406181:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 134 00000100:00100000:2.0:1787784995.449685:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784995.449925:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728137984 00000100:00100000:3.0:1787784995.449938:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728137984 00000100:00100000:3.0:1787784995.450009:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 135 00000100:00100000:3.0:1787784995.450022:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1bb492-200e-444d-8679-4c80592d7d80+11:18205:x1874627728137984:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787784995.450239:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1bb492-200e-444d-8679-4c80592d7d80+11:18205:x1874627728137984:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 218us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784995.450249:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 135 00000100:00100000:3.0:1787784995.457484:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784995.458832:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728138112 00000100:00100000:0.0:1787784995.458853:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728138112 00000100:00100000:0.0:1787784995.458937:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 136 00000100:00100000:0.0:1787784995.458950:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+11:18205:x1874627728138112:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787784995.459176:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+11:18205:x1874627728138112:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 226us (1783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784995.459186:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 136 00000100:00100000:1.0:1787784995.464917:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784995.465026:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728138240 00000100:00100000:3.0:1787784995.465040:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728138240 00000100:00100000:3.0:1787784995.465130:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 137 00000100:00100000:3.0:1787784995.465142:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1bb492-200e-444d-8679-4c80592d7d80+11:18199:x1874627728138240:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787784995.465183:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784995.465207:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c151e200/0x88ace7295d9eca4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e73004 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784995.465250:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c151e200/0x88ace7295d9eca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73004 expref: 12 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784995.465264:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c151e200/0x88ace7295d9eca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73004 expref: 12 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784995.465275:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c151e200, rc 0) 00000100:00100000:3.0:1787784995.465368:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1bb492-200e-444d-8679-4c80592d7d80+12:18199:x1874627728138240:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 226us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784995.465376:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 137 00000100:00100000:2.0:1787784995.474554:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784995.475289:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728138368 00000100:00100000:3.0:1787784995.475308:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728138368 00000100:00100000:3.0:1787784995.475536:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 138 00000100:00100000:3.0:1787784995.475549:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1bb492-200e-444d-8679-4c80592d7d80+12:18199:x1874627728138368:12345-192.168.202.41@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787784995.475588:0:22662:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787784995.475622:0:22662:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787784995.475627:0:22662:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787784995.475630:0:22662:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787784995.475633:0:22662:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787784995.475635:0:22662:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1787784995.481914:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1bb492-200e-444d-8679-4c80592d7d80+12:18199:x1874627728138368:12345-192.168.202.41@tcp:256:mount.lustre.0 Request processed in 6347us (7356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784995.481935:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 138 00000100:00100000:1.0:1787784995.487092:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784995.487222:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728138496 00000100:00100000:0.0:1787784995.487235:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728138496 00000100:00100000:0.0:1787784995.487314:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 139 00000100:00100000:0.0:1787784995.487328:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+12:18199:x1874627728138496:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787784995.487616:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784995.487645:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951fda12c00/0x88ace7295d9ecab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e7300b expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784995.487687:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951fda12c00/0x88ace7295d9ecab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7300b expref: 13 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784995.487700:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951fda12c00/0x88ace7295d9ecab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7300b expref: 13 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784995.487712:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951fda12c00, rc 0) 00000100:00100000:0.0:1787784995.488080:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+13:18199:x1874627728138496:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 752us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784995.488090:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 139 00000100:00100000:0.0:1787784995.490951:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784995.491071:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728138624 00000100:00100000:3.0:1787784995.491104:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728138624 00000100:00100000:3.0:1787784995.491303:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 140 00000100:00100000:3.0:1787784995.491316:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1bb492-200e-444d-8679-4c80592d7d80+13:18199:x1874627728138624:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787784995.491714:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1bb492-200e-444d-8679-4c80592d7d80+13:18199:x1874627728138624:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 399us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784995.491723:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 140 00000100:00100000:1.0:1787784995.494717:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784995.494920:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728138752 00000100:00100000:0.0:1787784995.494933:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728138752 00000100:00100000:0.0:1787784995.495036:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 141 00000100:00100000:0.0:1787784995.495048:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+13:18199:x1874627728138752:12345-192.168.202.41@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787784995.495642:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+13:18199:x1874627728138752:12345-192.168.202.41@tcp:503:mount.lustre.0 Request processed in 593us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784995.495651:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 141 00000100:00100000:1.0:1787784995.499215:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784995.499526:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728138880 00000100:00100000:3.0:1787784995.499539:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728138880 00000100:00100000:3.0:1787784995.499662:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 142 00000100:00100000:3.0:1787784995.499674:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1bb492-200e-444d-8679-4c80592d7d80+13:18209:x1874627728138880:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787784995.499942:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1bb492-200e-444d-8679-4c80592d7d80+13:18209:x1874627728138880:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 268us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784995.499951:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 142 00000100:00100000:1.0:1787784995.508929:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784995.513578:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728139008 00000100:00100000:0.0:1787784995.513603:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728139008 00000100:00100000:0.0:1787784995.513782:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 143 00000100:00100000:0.0:1787784995.513796:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+13:18209:x1874627728139008:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787784995.514033:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+13:18209:x1874627728139008:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 238us (5118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784995.514041:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 143 00000100:00100000:1.0:1787784995.520355:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784995.520425:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784995.520454:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784995.520502:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784995.520541:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728140032 00000100:00100000:1.0:1787784995.520553:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728140032 00000100:00100000:1.0:1787784995.520622:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:1.0:1787784995.520635:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:2407:x1874627728140032:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784995.520738:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:2407:x1874627728140032:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 105us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784995.520748:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:1.0:1787784995.520836:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784995.520942:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784995.520966:0:25465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728139136 00000100:00100000:1.0:1787784995.520970:0:25465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728139136 00000100:00100000:1.0:1787784995.520986:0:25465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728139392 00000100:00100000:1.0:1787784995.520988:0:25465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728139392 00000100:00100000:1.0:1787784995.520996:0:25465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728139776 00000100:00100000:1.0:1787784995.520999:0:25465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728139776 00000100:00100000:1.0:1787784995.521016:0:25465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728139904 00000100:00100000:1.0:1787784995.521019:0:25465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728139904 00000100:00100000:1.0:1787784995.521035:0:25465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:1.0:1787784995.521041:0:25465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+7:2407:x1874627728139776:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784995.521079:0:25465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+7:2407:x1874627728139776:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 37us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784995.521085:0:25465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:1.0:1787784995.521122:0:25465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 38 00000100:00100000:1.0:1787784995.521128:0:25465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:2407:x1874627728139904:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787784995.521174:0:25465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:2407:x1874627728139904:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 46us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784995.521181:0:25465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 38 00000100:00100000:1.0:1787784995.521230:0:25465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:1.0:1787784995.521235:0:25465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2404:x1874627728139136:12345-192.168.202.41@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787784995.521266:0:25465:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 315a9816-a5f4-4529-af39-1b0e9b8aed4e@192.168.202.41@tcp t0 exp 0000000000000000 cur 735 last 0 00000020:00000080:1.0:1787784995.521310:0:25465:0:(genops.c:1385:class_connect()) connect: client 315a9816-a5f4-4529-af39-1b0e9b8aed4e, cookie 0x88ace7295d9ecb2 00000004:00100000:1.0:1787784995.521344:0:25465:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787784995.521456:0:25465:0:(import.c:65:import_set_state_nolock()) ffff8951c85a5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784995.521510:0:25465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:2404:x1874627728139136:12345-192.168.202.41@tcp:38:mount.lustre.0 Request processed in 272us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784995.521517:0:25465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:1.0:1787784995.521531:0:25465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:1.0:1787784995.521536:0:25465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2404:x1874627728139392:12345-192.168.202.41@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787784995.521553:0:25465:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 315a9816-a5f4-4529-af39-1b0e9b8aed4e@192.168.202.41@tcp t0 exp 0000000000000000 cur 735 last 0 00000020:00000080:1.0:1787784995.521583:0:25465:0:(genops.c:1385:class_connect()) connect: client 315a9816-a5f4-4529-af39-1b0e9b8aed4e, cookie 0x88ace7295d9ecb9 00000004:00100000:1.0:1787784995.521598:0:25465:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787784995.521652:0:25465:0:(import.c:65:import_set_state_nolock()) ffff8951fb08a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784995.521675:0:25465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:2404:x1874627728139392:12345-192.168.202.41@tcp:38:mount.lustre.0 Request processed in 137us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784995.521681:0:25465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:3.0:1787784995.525851:0:24181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728140160 00000100:00100000:3.0:1787784995.525874:0:24181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728140160 00000100:00100000:3.0:1787784995.525973:0:24181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:3.0:1787784995.525985:0:24181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+5:2407:x1874627728140160:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787784995.526106:0:24181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+5:2407:x1874627728140160:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 122us (5162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784995.526114:0:24181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 8 00010000:00010000:3.0:1787784995.528851:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784995.535626:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784995.535787:0:25465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728139648 00000100:00100000:3.0:1787784995.535800:0:25465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728139648 00000100:00100000:3.0:1787784995.535899:0:25465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:3.0:1787784995.535913:0:25465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:18199:x1874627728139648:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787784995.535980:0:25465:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787784995.536076:0:25465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:18199:x1874627728139648:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 166us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784995.536084:0:25465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00080000:0.0:1787784995.536233:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784995.542925:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784995.543045:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784995.543311:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787784995.543730:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728139520 00000100:00100000:3.0:1787784995.543744:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728139520 00000100:00100000:3.0:1787784995.543848:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728139264 00000100:00100000:3.0:1787784995.543852:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728139264 00000100:00100000:3.0:1787784995.543880:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:3.0:1787784995.543891:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:0:x1874627728139520:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787784995.543934:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787784995.544026:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:0:x1874627728139520:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 137us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784995.544033:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:3.0:1787784995.544054:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:3.0:1787784995.544062:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:0:x1874627728139264:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787784995.544076:0:22670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787784995.544108:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:0:x1874627728139264:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 46us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784995.544114:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00080000:0.0:1787784995.544563:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787784995.546817:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728140288 00000100:00100000:0.0:1787784995.546839:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728140288 00000100:00100000:0.0:1787784995.546923:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:0.0:1787784995.546936:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:18199:x1874627728140288:12345-192.168.202.41@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787784995.547058:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:18199:x1874627728140288:12345-192.168.202.41@tcp:40:mount.lustre.0 Request processed in 124us (3746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784995.547068:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:0.0:1787784995.556272:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784995.556326:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784995.556570:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787784995.556715:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728140416 00000100:00100000:2.0:1787784995.556729:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728140416 00000100:00100000:2.0:1787784995.556806:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728140544 00000100:00100000:2.0:1787784995.556810:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728140544 00000100:00100000:2.0:1787784995.556837:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:2.0:1787784995.556847:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2404:x1874627728140416:12345-192.168.202.41@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787784995.556894:0:24179:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 315a9816-a5f4-4529-af39-1b0e9b8aed4e@192.168.202.41@tcp t0 exp 0000000000000000 cur 735 last 0 00000020:00000080:2.0:1787784995.556939:0:24179:0:(genops.c:1385:class_connect()) connect: client 315a9816-a5f4-4529-af39-1b0e9b8aed4e, cookie 0x88ace7295d9ecc0 00002000:00100000:2.0:1787784995.556956:0:24179:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 315a9816-a5f4-4529-af39-1b0e9b8aed4e/ffff8950c273b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787784995.556970:0:24179:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787784995.557064:0:24179:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787784995.557105:0:24179:0:(import.c:65:import_set_state_nolock()) ffff8950c2738000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787784995.557190:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:2404:x1874627728140416:12345-192.168.202.41@tcp:8:mount.lustre.0 Request processed in 343us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784995.557198:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:2.0:1787784995.557216:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:2.0:1787784995.557221:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3270f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2404:x1874627728140544:12345-192.168.202.41@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787784995.557238:0:24179:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 315a9816-a5f4-4529-af39-1b0e9b8aed4e@192.168.202.41@tcp t0 exp 0000000000000000 cur 735 last 0 00000020:00000080:2.0:1787784995.557255:0:24179:0:(genops.c:1385:class_connect()) connect: client 315a9816-a5f4-4529-af39-1b0e9b8aed4e, cookie 0x88ace7295d9ecc7 00002000:00100000:2.0:1787784995.557294:0:24179:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 315a9816-a5f4-4529-af39-1b0e9b8aed4e/ffff8950c273c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787784995.557301:0:24179:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787784995.557527:0:24179:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787784995.557547:0:24179:0:(import.c:65:import_set_state_nolock()) ffff8950c273f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787784995.557571:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3270f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:2404:x1874627728140544:12345-192.168.202.41@tcp:8:mount.lustre.0 Request processed in 349us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784995.557578:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:1.0:1787784995.558127:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728140672 00000100:00100000:1.0:1787784995.558136:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728140672 00000100:00100000:1.0:1787784995.558195:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:1.0:1787784995.558204:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3271e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:18199:x1874627728140672:12345-192.168.202.41@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787784995.558313:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3271e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:18199:x1874627728140672:12345-192.168.202.41@tcp:900:mount.lustre.0 Request processed in 110us (2069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784995.558321:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:0.0:1787784995.562037:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787784995.562502:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728140800 00000100:00100000:1.0:1787784995.562516:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728140800 00000100:00100000:1.0:1787784995.562653:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:1.0:1787784995.562666:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3272580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:18199:x1874627728140800:12345-192.168.202.41@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787784995.562842:0:22673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787784995.562968:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3272580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:18199:x1874627728140800:12345-192.168.202.41@tcp:33:mount.lustre.0 Request processed in 304us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784995.562978:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:2.0:1787784995.756928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787784995.757054:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728140928 00000100:00100000:0.0:1787784995.757068:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728140928 00000100:00100000:0.0:1787784995.757169:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:0.0:1787784995.757181:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:18232:x1874627728140928:12345-192.168.202.41@tcp:101:mkdir.0 00010000:00010000:0.0:1787784995.757210:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784995.757240:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12200/0x88ace7295d9ecce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e7303c expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784995.757368:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13a00/0x88ace7295d9ecd5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784995.757408:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13a00/0x88ace7295d9ecd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784995.757426:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13a00/0x88ace7295d9ecd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784995.757497:0:22670:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787784995.757502:0:22670:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787784995.757530:0:22670:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13a00/0x88ace7295d9ecd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784995.757566:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12200/0x88ace7295d9ecce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7303c expref: 8 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784995.757592:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13a00/0x88ace7295d9ecd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7303c expref: 7 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784995.757602:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128900) 00010000:00010000:0.0:1787784995.757605:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784995.757609:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951fda13a00, rc 0) 00000100:00100000:0.0:1787784995.757702:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+7:18232:x1874627728140928:12345-192.168.202.41@tcp:101:mkdir.0 Request processed in 523us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784995.757711:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00010000:00010000:3.0:1787784996.566792:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784997.511581:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784997.511614:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750273792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787784997.511710:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784997.511837:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750273792 00000100:00100000:2.0:1787784997.511849:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750273792 00000100:00100000:2.0:1787784997.511923:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787784997.511935:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbe5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750273792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787784997.511987:0:24183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787784997.512044:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbe5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750273792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784997.512053:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1787784997.512093:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784997.512300:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750273792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787784997.519805:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784997.519845:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f53c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750273920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784997.519956:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784997.520857:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750273920 00000100:00100000:2.0:1787784997.520872:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750273920 00000100:00100000:2.0:1787784997.520954:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787784997.520976:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750273920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787784997.521011:0:24183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787784997.521111:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750273920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784997.521119:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787784997.521186:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f53c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750273920:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787784997.521654:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787784997.574082:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784998.023860:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fbe59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750274048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787784998.023976:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784998.024260:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784998.024273:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3273c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750274176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787784998.024310:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784998.024360:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750274048 00000100:00100000:0.0:1787784998.024380:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750274048 00000100:00100000:0.0:1787784998.024477:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750274176 00000100:00100000:0.0:1787784998.024483:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750274176 00000100:00100000:0.0:1787784998.024501:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787784998.024509:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbe5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750274048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787784998.024554:0:23412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787784998.024610:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbe5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750274048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784998.024618:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787784998.024636:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787784998.024643:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750274176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787784998.024663:0:23412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787784998.024999:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750274176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 355us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784998.025006:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787784998.025066:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3273c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750274176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787784998.025105:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fbe59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750274048:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1787784998.026176:0:22705:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787784998.534275:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb2543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750274688:0@lo:400:kworker.0 00000100:00100000:2.0:1787784998.534392:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784998.534475:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb256940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750275200:0@lo:400:kworker.0 00000100:00100000:2.0:1787784998.534500:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784998.534532:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787784998.534539:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e11354d-250d-4393-8e0e-7593eb008ce7:3644:1874627750274304:0@lo:400:kworker.0 00000100:00100000:2.0:1787784998.534572:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784998.534575:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3273c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750274560:0@lo:400:kworker.0 00000100:00100000:2.0:1787784998.534607:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb2561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750274816:0@lo:400:kworker.0 00000100:00100000:0.0:1787784998.534624:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784998.534634:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750274432:0@lo:400:kworker.0 00000100:00100000:0.0:1787784998.534649:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb256580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750275072:0@lo:400:kworker.0 00000100:00100000:2.0:1787784998.534658:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784998.534669:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784998.534674:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb256d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750274944:0@lo:400:kworker.0 00000100:00100000:1.0:1787784998.535501:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784998.535519:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750275712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784998.540685:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750274304 00000100:00100000:3.0:1787784998.540708:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750274304 00000100:00100000:3.0:1787784998.540814:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787784998.540829:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+24:3644:x1874627750274304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784998.543151:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750275584:0@lo:400:kworker.0 00000100:00100000:0.0:1787784998.544975:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784998.545308:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750274688 00000100:00100000:1.0:1787784998.545321:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750274688 00000100:00100000:1.0:1787784998.545378:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750275200 00000100:00100000:1.0:1787784998.545382:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750275200 00000100:00100000:1.0:1787784998.545416:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750275072 00000100:00100000:1.0:1787784998.545419:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750275072 00000100:00100000:1.0:1787784998.545430:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750275584 00000100:00100000:1.0:1787784998.545432:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750275584 00000100:00100000:1.0:1787784998.545477:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787784998.545488:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbe59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750274688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784998.545570:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbe59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750274688:12345-0@lo:400:kworker.0 Request processed in 83us (11179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784998.545609:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787784998.545628:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787784998.545635:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbe58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750275200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784998.545669:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbe58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750275200:12345-0@lo:400:kworker.0 Request processed in 35us (11169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784998.545675:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787784998.545687:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787784998.547533:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787784998.547565:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5292d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750275584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784998.549042:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5292d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874627750275584:12345-0@lo:400:kworker.0 Request processed in 1489us (4077us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784998.549054:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787784998.549641:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5291a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750275072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784998.549734:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5291a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874627750275072:12345-0@lo:400:kworker.0 Request processed in 4040us (15062us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784998.549742:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1787784998.549789:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787784998.549797:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784998.550029:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784998.550631:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb256580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874627750275072:0@lo:400:kworker.0 00010000:00080000:1.0:1787784998.550657:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f5293c00 x1874627750275584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787785014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784998.550686:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1874627750275584:0@lo:400:kworker.0 00000100:00100000:1.0:1787784998.550885:0:24684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750274560 00000100:00100000:1.0:1787784998.550895:0:24684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750274560 00000100:00100000:1.0:1787784998.550959:0:24684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750274432 00000100:00100000:1.0:1787784998.550963:0:24684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750274432 00000100:00100000:1.0:1787784998.551011:0:24684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787784998.551021:0:24684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f52912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750274560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784998.551100:0:24684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f52912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750274560:12345-0@lo:400:kworker.0 Request processed in 79us (16474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784998.552062:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787784998.552081:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbe59e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750274432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784998.552151:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbe59e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750274432:12345-0@lo:400:kworker.0 Request processed in 78us (17491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784998.552159:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000001:00100000:0.0:1787784998.552243:0:24176:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 315a9816-a5f4-4529-af39-1b0e9b8aed4e 00000001:00100000:0.0:1787784998.552254:0:24176:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3afbc3a9-7189-4bc3-a69b-cd7ebe093899 00000100:00100000:0.0:1787784998.552274:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784998.556068:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb255e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750275328:0@lo:400:kworker.0 00000100:00100000:0.0:1787784998.556180:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784998.556277:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb2543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750274688:0@lo:400:kworker.0 00000100:00100000:0.0:1787784998.557785:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb256940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750275200:0@lo:400:kworker.0 00000100:00100000:0.0:1787784998.557870:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750274816 00000100:00100000:0.0:1787784998.557878:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750274816 00000100:00100000:0.0:1787784998.557943:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787784998.557952:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5291680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750274816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784998.558076:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5291680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750274816:12345-0@lo:400:kworker.0 Request processed in 124us (5801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784998.558084:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787784998.558116:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750275328 00000100:00100000:0.0:1787784998.558121:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750275328 00000100:00100000:2.0:1787784998.560778:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784998.560882:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750275712 00000100:00100000:2.0:1787784998.560906:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750275712 00000100:00100000:2.0:1787784998.560975:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787784998.560988:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874627750275712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787784998.561036:0:24183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787784998.561138:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874627750275712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (11110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784998.561167:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787784998.561220:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750274944 00000100:00100000:2.0:1787784998.561224:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750274944 00000100:00100000:2.0:1787784998.561253:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787784998.561260:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fbe58b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750274944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784998.561320:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fbe58b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750274944:12345-0@lo:400:kworker.0 Request processed in 61us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784998.561326:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787784998.561584:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1787784998.561614:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750275712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784998.561653:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb256d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750274944:0@lo:400:kworker.0 00000100:00100000:2.0:1787784998.561667:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e1196580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750275456:0@lo:400:kworker.0 00000100:00100000:2.0:1787784998.561710:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784998.563603:0:25465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750275456 00000100:00100000:2.0:1787784998.563622:0:25465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750275456 00000100:00100000:1.0:1787784998.563947:0:24684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787784998.563990:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787784998.564002:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750275328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784998.564267:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874627750275328:12345-0@lo:400:kworker.0 Request processed in 266us (8085us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784998.564276:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787784998.564309:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787784998.564316:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750275456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784998.564351:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750275456:12345-0@lo:400:kworker.0 Request processed in 37us (2640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784998.564357:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787784998.564485:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3273c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750274560:0@lo:400:kworker.0 00000100:00100000:1.0:1787784998.564574:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb2561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750274816:0@lo:400:kworker.0 00010000:00080000:1.0:1787784998.564594:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951fb255e00 x1874627750275328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787785014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784998.564609:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb255e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1874627750275328:0@lo:400:kworker.0 00000001:00100000:1.0:1787784998.564660:0:23404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 315a9816-a5f4-4529-af39-1b0e9b8aed4e 00000001:00100000:1.0:1787784998.564671:0:23404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3afbc3a9-7189-4bc3-a69b-cd7ebe093899 00000100:00080000:1.0:1787784998.564720:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784998.564726:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787784998.564751:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784998.565063:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784998.565090:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5290f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750275840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787784998.565167:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784998.565723:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750275840 00000100:00100000:2.0:1787784998.565738:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750275840 00000100:00100000:2.0:1787784998.565809:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787784998.565819:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f5291e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750275840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787784998.565846:0:24183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787784998.571713:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f5291e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750275840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5880us (6530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784998.571734:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787784998.571985:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5290f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750275840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787784998.572042:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e1196580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750275456:0@lo:400:kworker.0 00000100:00100000:2.0:1787784998.572113:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750274432:0@lo:400:kworker.0 00000100:00100000:3.0:1787784998.595818:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+24:3644:x1874627750274304:12345-0@lo:400:kworker.0 Request processed in 54973us (61225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784998.595841:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787784998.595942:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e11354d-250d-4393-8e0e-7593eb008ce7:3644:1874627750274304:0@lo:400:kworker.0 00010000:00010000:3.0:1787784998.603385:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787784998.603411:0:22650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 315a9816-a5f4-4529-af39-1b0e9b8aed4e 00000001:00100000:3.0:1787784998.603427:0:22650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3afbc3a9-7189-4bc3-a69b-cd7ebe093899 00000001:02000400:2.0:1787784999.312169:0:25551:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787784999.623343:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787785000.646181:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787785000.739820:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785000.739858:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785000.739880:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785000.739901:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785000.739920:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785000.739939:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785000.739959:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785000.739976:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785000.740011:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785000.740045:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728141056 00000100:00100000:3.0:1787785000.740054:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728141056 00000100:00100000:3.0:1787785000.740101:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 145 00000100:00100000:3.0:1787785000.740110:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+13:2407:x1874627728141056:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787785000.740180:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+13:2407:x1874627728141056:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 70us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785000.740197:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 145 00000100:00100000:3.0:1787785000.740230:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728141312 00000100:00100000:3.0:1787785000.740233:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728141312 00000100:00100000:3.0:1787785000.740260:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728141184 00000100:00100000:3.0:1787785000.740263:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728141184 00000100:00100000:3.0:1787785000.740273:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728141824 00000100:00100000:3.0:1787785000.740275:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728141824 00000100:00100000:3.0:1787785000.740285:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728141696 00000100:00100000:3.0:1787785000.740287:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728141696 00000100:00100000:3.0:1787785000.740299:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 45 00000100:00100000:3.0:1787785000.740305:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+5:2407:x1874627728141312:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787785000.740334:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+5:2407:x1874627728141312:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 29us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785000.740340:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 45 00000100:00100000:3.0:1787785000.740351:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:3.0:1787785000.740356:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f53c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:2408:x1874627728141184:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787785000.740378:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f53c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:2408:x1874627728141184:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 22us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785000.740384:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:3.0:1787785000.740394:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:3.0:1787785000.740399:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:315a9816-a5f4-4529-af39-1b0e9b8aed4e+5:2407:x1874627728141824:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787785000.740439:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:315a9816-a5f4-4529-af39-1b0e9b8aed4e+5:2407:x1874627728141824:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 39us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785000.740445:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:3.0:1787785000.740457:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 48 00000100:00100000:3.0:1787785000.740470:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3386940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:2408:x1874627728141696:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787785000.740496:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3386940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:2408:x1874627728141696:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 26us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785000.740502:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 48 00000100:00100000:3.0:1787785000.740522:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728141568 00000100:00100000:3.0:1787785000.740529:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728141568 00000100:00100000:3.0:1787785000.740548:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728141440 00000100:00100000:3.0:1787785000.740551:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728141440 00000100:00100000:3.0:1787785000.740560:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728142080 00000100:00100000:3.0:1787785000.740562:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728142080 00000100:00100000:3.0:1787785000.740570:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728141952 00000100:00100000:3.0:1787785000.740572:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728141952 00000100:00100000:3.0:1787785000.740583:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:3.0:1787785000.740589:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3384f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+5:2407:x1874627728141568:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787785000.740612:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3384f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+5:2407:x1874627728141568:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 24us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785000.740618:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:3.0:1787785000.740631:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:3.0:1787785000.740636:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3385a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+5:2408:x1874627728141440:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787785000.740658:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3385a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+5:2408:x1874627728141440:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 22us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785000.740663:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:3.0:1787785000.740673:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:3.0:1787785000.740679:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3385680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:2407:x1874627728142080:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787785000.740700:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3385680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:2407:x1874627728142080:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 22us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785000.740711:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:3.0:1787785000.740721:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:3.0:1787785000.740726:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3386d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:315a9816-a5f4-4529-af39-1b0e9b8aed4e+5:2408:x1874627728141952:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1787785000.740745:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3386d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:315a9816-a5f4-4529-af39-1b0e9b8aed4e+5:2408:x1874627728141952:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 19us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785000.740750:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00080000:3.0:1787785000.740961:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787785000.740966:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787785000.740968:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787785000.740970:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:1.0:1787785001.621681:0:24995:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 315a9816-a5f4-4529-af39-1b0e9b8aed4e 00010000:00010000:3.0:1787785001.674313:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787785002.631194:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750276096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787785002.632005:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787785002.632209:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750275968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787785002.632262:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787785002.634119:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750276096 00000100:00100000:2.0:1787785002.634137:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750276096 00000100:00100000:2.0:1787785002.634440:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750275968 00000100:00100000:2.0:1787785002.634444:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750275968 00000100:00100000:2.0:1787785002.634472:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787785002.634485:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750276096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787785002.634535:0:24183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787785002.634643:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750276096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (2643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785002.634651:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787785002.634671:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787785002.634678:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951f52903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750275968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787785002.634689:0:24183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787785002.634720:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951f52903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750275968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (2457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785002.634726:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787785002.635237:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750275968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787785002.635373:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750276096:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787785002.635491:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787785002.694557:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787785003.078626:0:23428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787785003.148867:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750276224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787785003.149051:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787785003.149939:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750276352:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787785003.150000:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787785003.150066:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750276224 00000100:00100000:1.0:1787785003.150077:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750276224 00000100:00100000:1.0:1787785003.150143:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750276352 00000100:00100000:1.0:1787785003.150147:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750276352 00000100:00100000:1.0:1787785003.150166:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787785003.150175:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750276224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787785003.150223:0:22675:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787785003.150280:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750276224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785003.150289:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787785003.150308:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787785003.150315:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750276352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787785003.150335:0:22675:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787785003.150369:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750276352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785003.150375:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787785003.150434:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750276224:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787785003.150470:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750276352:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787785003.658295:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f52930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e11354d-250d-4393-8e0e-7593eb008ce7:3646:1874627750276480:0@lo:400:kworker.0 00000100:00100000:0.0:1787785003.658422:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787785003.658480:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750276992:0@lo:400:kworker.0 00000100:00100000:0.0:1787785003.658511:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787785003.658535:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750277504:0@lo:400:kworker.0 00000100:00100000:0.0:1787785003.658560:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787785003.658590:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787785003.658718:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5292940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750276608:0@lo:400:kworker.0 00000100:00100000:0.0:1787785003.658746:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787785003.658794:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5293840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750277120:0@lo:400:kworker.0 00000100:00100000:0.0:1787785003.658819:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787785003.658838:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c34121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750277632:0@lo:400:kworker.0 00000100:00100000:0.0:1787785003.658859:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787785003.658894:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5292580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750276736:0@lo:400:kworker.0 00000100:00100000:0.0:1787785003.658924:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787785003.658943:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f52921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750277248:0@lo:400:kworker.0 00000100:00100000:0.0:1787785003.658995:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787785003.659016:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750277760:0@lo:400:kworker.0 00000100:00100000:0.0:1787785003.659044:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787785003.659066:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787785003.659072:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5290780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750276864:0@lo:400:kworker.0 00000100:00100000:0.0:1787785003.659095:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787785003.659106:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951f5290f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750277376:0@lo:400:kworker.0 00000100:00100000:0.0:1787785003.659126:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787785003.659161:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750276480 00000100:00100000:0.0:1787785003.659170:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750276480 00000100:00100000:0.0:1787785003.659233:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787785003.659244:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+24:3646:x1874627750276480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787785003.659539:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+24:3646:x1874627750276480:12345-0@lo:400:kworker.0 Request processed in 297us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787785003.659549:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787785003.659587:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750276992 00000100:00100000:0.0:1787785003.659590:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750276992 00000100:00100000:0.0:1787785003.659845:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750276608 00000100:00100000:0.0:1787785003.659849:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750276608 00000100:00100000:0.0:1787785003.659862:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750277120 00000100:00100000:0.0:1787785003.659864:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750277120 00000100:00100000:0.0:1787785003.659892:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750276736 00000100:00100000:0.0:1787785003.659895:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750276736 00000100:00100000:0.0:1787785003.659911:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787785003.659918:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3413840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750276992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787785003.659961:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3413840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750276992:12345-0@lo:400:kworker.0 Request processed in 43us (1448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787785003.659983:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787785003.659996:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787785003.660002:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c34112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750276608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787785003.660412:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c12afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750277888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787785003.660458:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787785003.660499:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750277888 00000100:00100000:2.0:1787785003.660503:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750277888 00000100:00100000:2.0:1787785003.660530:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787785003.660537:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e1196580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874627750277888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787785003.660572:0:24183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787785003.660752:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e1196580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1874627750277888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 214us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785003.660760:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787785003.660863:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c12afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750277888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787785003.660945:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c34112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750276608:12345-0@lo:400:kworker.0 Request processed in 34us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787785003.660953:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787785003.660969:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787785003.660977:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3410f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750277120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787785003.661014:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3410f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750277120:12345-0@lo:400:kworker.0 Request processed in 39us (2194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787785003.661020:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787785003.661031:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787785003.661214:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e6556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750276736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787785003.661251:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e6556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750276736:12345-0@lo:400:kworker.0 Request processed in 213us (2326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787785003.661257:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787785003.661520:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750277504 00000100:00100000:0.0:1787785003.661527:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750277504 00000100:00100000:0.0:1787785003.661558:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750277632 00000100:00100000:0.0:1787785003.661561:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750277632 00000100:00100000:0.0:1787785003.661574:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750277248 00000100:00100000:0.0:1787785003.661577:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750277248 00000100:00100000:0.0:1787785003.661587:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750277760 00000100:00100000:0.0:1787785003.661590:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750277760 00000100:00100000:1.0:1787785003.661860:0:25465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750276864 00000100:00100000:1.0:1787785003.661866:0:25465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750276864 00000100:00100000:1.0:1787785003.661889:0:25465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750277376 00000100:00100000:1.0:1787785003.661892:0:25465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750277376 00000100:00100000:1.0:1787785003.661910:0:25465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787785003.661919:0:25465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3412580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750277504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787785003.661971:0:25465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3412580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750277504:12345-0@lo:400:kworker.0 Request processed in 53us (3409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785003.661978:0:25465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787785003.661991:0:25465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787785003.661997:0:25465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3410b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750277632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787785003.662028:0:25465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3410b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750277632:12345-0@lo:400:kworker.0 Request processed in 31us (3167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785003.662045:0:25465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787785003.662059:0:25465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787785003.662065:0:25465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750277248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787785003.662095:0:25465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874627750277248:12345-0@lo:400:kworker.0 Request processed in 30us (3099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785003.662100:0:25465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787785003.662111:0:25465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787785003.662117:0:25465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3411680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750276864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787785003.662147:0:25465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3411680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874627750276864:12345-0@lo:400:kworker.0 Request processed in 30us (3051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785003.662153:0:25465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787785003.662166:0:25465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787785003.662172:0:25465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3411a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750277376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787785003.662247:0:25465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3411a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874627750277376:12345-0@lo:400:kworker.0 Request processed in 76us (3120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785003.662253:0:25465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787785003.662896:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5292940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750276608:0@lo:400:kworker.0 00000100:00100000:2.0:1787785003.662916:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5293840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750277120:0@lo:400:kworker.0 00000100:00100000:2.0:1787785003.662929:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c34121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750277632:0@lo:400:kworker.0 00000100:00100000:2.0:1787785003.662942:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f52930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e11354d-250d-4393-8e0e-7593eb008ce7:3646:1874627750276480:0@lo:400:kworker.0 00000100:00100000:2.0:1787785003.662956:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750276992:0@lo:400:kworker.0 00010000:00080000:2.0:1787785003.662972:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951f5293c00 x1874627750277504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787785019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787785003.662985:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750277504:0@lo:400:kworker.0 00000100:00100000:0.0:1787785003.666697:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787785003.666717:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3413c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750277760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787785003.666895:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3413c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874627750277760:12345-0@lo:400:kworker.0 Request processed in 183us (7848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787785003.666903:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1787785003.666946:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787785003.666953:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787785003.666957:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787785003.667036:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787785003.667054:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750278016:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787785003.667103:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787785003.667156:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750278016 00000100:00100000:0.0:1787785003.667167:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750278016 00000100:00100000:0.0:1787785003.667200:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787785003.667208:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c34112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750278016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787785003.667229:0:24183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787785003.669611:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5290780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874627750276864:0@lo:400:kworker.0 00000100:00100000:2.0:1787785003.669636:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5290f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1874627750277376:0@lo:400:kworker.0 00000100:00100000:2.0:1787785003.669652:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f5292580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750276736:0@lo:400:kworker.0 00000100:00100000:2.0:1787785003.669665:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951f52921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874627750277248:0@lo:400:kworker.0 00010000:00080000:2.0:1787785003.669682:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8950c3410000 x1874627750277760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787785019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787785003.669694:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1874627750277760:0@lo:400:kworker.0 00000100:00100000:0.0:1787785003.671076:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c34112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874627750278016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3857us (3961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787785003.671093:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787785003.674568:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1874627750278016:0@lo:13:osp-pre-1-1.0 00000020:00000080:2.0:1787785003.682991:0:25699:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda8cca180 20000000:00000080:2.0:1787785003.683020:0:25699:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8951fdace800 uarg=0000000000000000 20000000:01000000:2.0:1787785003.683227:0:25699:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787785003.683235:0:25699:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787785003.683241:0:25699:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787785003.684669:0:25700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1787785003.685095:0:25699:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787785003.691642:0:25699:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787785003.691853:0:25699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8951c151f200/0x88ace7295d9ecdc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785003.691879:0:25699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951c151e400/0x88ace7295d9e939 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e932 expref: 23 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785003.691888:0:25699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951e1d35200/0x88ace7295d9e947 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e940 expref: 23 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785003.691896:0:25699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951df602a00/0x88ace7295d9e986 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9e97f expref: 23 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785003.691902:0:25699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951d1629000/0x88ace7295d9eb07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9eb00 expref: 23 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785003.691913:0:25699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951c151f600/0x88ace7295d9ec6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f9b expref: 12 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785003.691942:0:25699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8951fda12c00/0x88ace7295d9ecab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7300b expref: 12 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785003.691949:0:25699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8951c151f200/0x88ace7295d9ecdc lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785003.692011:0:25699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951fda12c00/0x88ace7295d9ecab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7300b expref: 12 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785003.692031:0:25699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951fda12c00/0x88ace7295d9ecab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7300b expref: 12 pid: 22663 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787785003.692052:0:25699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3386580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25699:1874627750278144:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787785003.692231:0:25699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951c151f600/0x88ace7295d9ec6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f9b expref: 12 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785003.692240:0:25699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951c151f600/0x88ace7295d9ec6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f9b expref: 12 pid: 22662 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787785003.692249:0:25699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c33870c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25699:1874627750278272:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787785003.692296:0:25699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951d1629000/0x88ace7295d9eb07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9eb00 expref: 23 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785003.692305:0:25699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951d1629000/0x88ace7295d9eb07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9eb00 expref: 23 pid: 22662 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787785003.692314:0:25699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c33861c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25699:1874627750278400:0@lo:104: 00000100:00100000:3.0:1787785003.692365:0:25699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787785003.692438:0:25699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951df602a00/0x88ace7295d9e986 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9e97f expref: 23 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785003.692447:0:25699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951df602a00/0x88ace7295d9e986 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9e97f expref: 23 pid: 22664 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787785003.692455:0:25699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3384b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25699:1874627750278528:0@lo:104: 00000100:00100000:3.0:1787785003.692478:0:25699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787785003.692500:0:25699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951e1d35200/0x88ace7295d9e947 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9e940 expref: 23 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785003.692507:0:25699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951e1d35200/0x88ace7295d9e947 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9e940 expref: 23 pid: 22662 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787785003.692516:0:25699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3384780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25699:1874627750278656:0@lo:104: 00000100:00100000:3.0:1787785003.692536:0:25699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787785003.692553:0:25699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8951c151e400/0x88ace7295d9e939 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88ace7295d9e932 expref: 23 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785003.692562:0:25699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8951c151e400/0x88ace7295d9e939 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88ace7295d9e932 expref: 23 pid: 22664 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787785003.692570:0:25699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c33852c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25699:1874627750278784:0@lo:104: 00000100:00100000:3.0:1787785003.692592:0:25699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787785003.692601:0:25699:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df646840 going to sleep for 11 seconds 00000100:00100000:1.0:1787785003.693098:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750278400 00000100:00100000:1.0:1787785003.693108:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750278400 00000100:00100000:1.0:1787785003.693161:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750278528 00000100:00100000:1.0:1787785003.693165:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750278528 00000100:00100000:1.0:1787785003.693177:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750278656 00000100:00100000:1.0:1787785003.693179:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750278656 00000100:00100000:1.0:1787785003.693188:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750278784 00000100:00100000:1.0:1787785003.693190:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750278784 00000100:00100000:1.0:1787785003.693206:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787785003.693215:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3387c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+6:25699:x1874627750278400:12345-0@lo:104: 00010000:00010000:1.0:1787785003.693231:0:22653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951fda12000/0x88ace7295d9eb00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9eb07 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.693315:0:22653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787785003.693322:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3387c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+6:25699:x1874627750278400:12345-0@lo:104: Request processed in 107us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785003.693330:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787785003.693350:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787785003.693356:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3384000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+5:25699:x1874627750278528:12345-0@lo:104: 00010000:00010000:1.0:1787785003.693364:0:22653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9e97f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e986 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.693410:0:22653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787785003.693416:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3384000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+5:25699:x1874627750278528:12345-0@lo:104: Request processed in 61us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785003.693434:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787785003.693449:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787785003.693455:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3387840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+4:25699:x1874627750278656:12345-0@lo:104: 00010000:00010000:1.0:1787785003.693464:0:22653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951c151fc00/0x88ace7295d9e940 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e947 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.693501:0:22653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787785003.693506:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3387840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+4:25699:x1874627750278656:12345-0@lo:104: Request processed in 52us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785003.693512:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787785003.693523:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787785003.693529:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3385e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+3:25699:x1874627750278784:12345-0@lo:104: 00010000:00010000:1.0:1787785003.693537:0:22653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9e932 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e939 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.693561:0:22653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787785003.693566:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3385e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e11354d-250d-4393-8e0e-7593eb008ce7+3:25699:x1874627750278784:12345-0@lo:104: Request processed in 38us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785003.693572:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787785003.693591:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787785003.693598:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951fda12000/0x88ace7295d9eb00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9eb07 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.693607:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951fda12000 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:1.0:1787785003.693612:0:22658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951fda12000/0x88ace7295d9eb00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9eb07 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.693633:0:22658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951fda12000/0x88ace7295d9eb00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9eb07 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787785003.693641:0:22658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951fda12000/0x88ace7295d9eb00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9eb07 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787785003.693647:0:22658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787785003.693683:0:22658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951fda12000/0x88ace7295d9eb00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9eb07 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.693689:0:22658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787785003.693714:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951fda12000/0x88ace7295d9eb00 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9eb07 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.693723:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951fda12000/0x88ace7295d9eb00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9eb07 expref: -99 pid: 24994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.693741:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787785003.693744:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9e97f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e986 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.693750:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603400 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:1.0:1787785003.693752:0:22658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9e97f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9e986 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.693758:0:22658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9e97f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9e986 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787785003.693765:0:22658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9e97f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9e986 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787785003.693819:0:22658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787785003.693836:0:22658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9e97f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e986 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.693842:0:22658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787785003.693860:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9e97f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e986 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.693867:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951df603400/0x88ace7295d9e97f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e986 expref: -99 pid: 24175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.693876:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787785003.693880:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951c151fc00/0x88ace7295d9e940 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e947 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.693886:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151fc00 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:1.0:1787785003.693888:0:22658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951c151fc00/0x88ace7295d9e940 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9e947 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.693895:0:22658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951c151fc00/0x88ace7295d9e940 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9e947 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787785003.693902:0:22658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951c151fc00/0x88ace7295d9e940 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9e947 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787785003.693907:0:22658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787785003.693920:0:22658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951c151fc00/0x88ace7295d9e940 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e947 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.693926:0:22658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787785003.693940:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951c151fc00/0x88ace7295d9e940 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e947 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.693946:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951c151fc00/0x88ace7295d9e940 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e947 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.693958:0:22658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787785003.693961:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9e932 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88ace7295d9e939 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.693968:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629400 already unused, calling callback (ffffffffc1382c20) 10000000:00010000:1.0:1787785003.693971:0:22658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9e932 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88ace7295d9e939 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.693978:0:22658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9e932 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88ace7295d9e939 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787785003.693983:0:22658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9e932 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88ace7295d9e939 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787785003.693988:0:22658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787785003.694002:0:22658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9e932 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e939 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.694008:0:22658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787785003.694014:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9e932 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e939 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.694021:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff8951d1629400/0x88ace7295d9e932 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88ace7295d9e939 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.694038:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787785003.694045:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787785003.694047:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787785003.694055:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787785003.694061:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787785003.694228:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e11354d-250d-4393-8e0e-7593eb008ce7:3647:1874627750278912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787785003.694296:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787785003.694355:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787785003.694362:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e11354d-250d-4393-8e0e-7593eb008ce7:3647:1874627750279296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787785003.694384:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787785003.694434:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750278912 00000100:00100000:0.0:1787785003.694441:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750278912 00010000:00010000:0.0:1787785003.694471:0:22656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951d1629000/0x88ace7295d9eb07 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9eb00 expref: 24 pid: 22662 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787785003.694509:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750279296 00000100:00100000:0.0:1787785003.694512:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750279296 00010000:00010000:0.0:1787785003.694524:0:22656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951c151e400/0x88ace7295d9e939 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e932 expref: 25 pid: 22664 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787785003.694537:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787785003.694544:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3413840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e11354d-250d-4393-8e0e-7593eb008ce7+25:3647:x1874627750278912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787785003.694557:0:22656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787785003.694563:0:22656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951d1629000/0x88ace7295d9eb07 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9eb00 expref: 25 pid: 22662 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785003.694574:0:22656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951d1629000/0x88ace7295d9eb07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9eb00 expref: 25 pid: 22662 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785003.694594:0:22656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787785003.694623:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3413840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e11354d-250d-4393-8e0e-7593eb008ce7+25:3647:x1874627750278912:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787785003.694631:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787785003.694645:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787785003.694651:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3410f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e11354d-250d-4393-8e0e-7593eb008ce7+24:3647:x1874627750279296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787785003.694659:0:22656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787785003.694663:0:22656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951c151e400/0x88ace7295d9e939 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e932 expref: 24 pid: 22664 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785003.694672:0:22656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951c151e400/0x88ace7295d9e939 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9e932 expref: 24 pid: 22664 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785003.694681:0:22656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787785003.694709:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3410f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e11354d-250d-4393-8e0e-7593eb008ce7+24:3647:x1874627750279296:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787785003.694715:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787785003.694752:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e11354d-250d-4393-8e0e-7593eb008ce7:3647:1874627750279296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787785003.694761:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e11354d-250d-4393-8e0e-7593eb008ce7:3647:1874627750278912:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787785003.695061:0:25699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951d1629000/0x88ace7295d9eb07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9eb00 expref: 23 pid: 22662 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787785003.695074:0:25699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c33861c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25699:1874627750278400:0@lo:104: 00000100:00100000:3.0:1787785003.695087:0:25699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3384b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25699:1874627750278528:0@lo:104: 00000100:00100000:3.0:1787785003.695107:0:25699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3384780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25699:1874627750278656:0@lo:104: 00010000:00010000:3.0:1787785003.695118:0:25699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c151e400/0x88ace7295d9e939 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9e932 expref: 22 pid: 22664 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787785003.695128:0:25699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c33852c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25699:1874627750278784:0@lo:104: 00000100:00100000:3.0:1787785003.695171:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e11354d-250d-4393-8e0e-7593eb008ce7:3644:1874627750279040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787785003.695206:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787785003.695234:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787785003.695240:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e11354d-250d-4393-8e0e-7593eb008ce7:3644:1874627750279168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787785003.695261:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787785003.695537:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750279040 00000100:00100000:3.0:1787785003.695542:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750279040 00010000:00010000:3.0:1787785003.695567:0:22657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951df602a00/0x88ace7295d9e986 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e97f expref: 22 pid: 22664 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787785003.695584:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750279168 00000100:00100000:3.0:1787785003.695587:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750279168 00010000:00010000:3.0:1787785003.695597:0:22657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951e1d35200/0x88ace7295d9e947 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e940 expref: 23 pid: 22662 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787785003.695610:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787785003.695616:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3384f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e11354d-250d-4393-8e0e-7593eb008ce7+23:3644:x1874627750279040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787785003.695628:0:22657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787785003.695632:0:22657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951df602a00/0x88ace7295d9e986 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e97f expref: 23 pid: 22664 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785003.695642:0:22657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951df602a00/0x88ace7295d9e986 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9e97f expref: 23 pid: 22664 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785003.695667:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951df602a00/0x88ace7295d9e986 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9e97f expref: 23 pid: 22664 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785003.695680:0:22657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787785003.695711:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3384f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e11354d-250d-4393-8e0e-7593eb008ce7+22:3644:x1874627750279040:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785003.695718:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787785003.695735:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787785003.695741:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3385a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e11354d-250d-4393-8e0e-7593eb008ce7+21:3644:x1874627750279168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787785003.695749:0:22657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787785003.695753:0:22657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951e1d35200/0x88ace7295d9e947 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88ace7295d9e940 expref: 21 pid: 22662 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785003.695761:0:22657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951e1d35200/0x88ace7295d9e947 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88ace7295d9e940 expref: 21 pid: 22662 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785003.695850:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951e1d35200/0x88ace7295d9e947 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88ace7295d9e940 expref: 21 pid: 22662 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785003.695861:0:22657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787785003.695884:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3385a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e11354d-250d-4393-8e0e-7593eb008ce7+20:3644:x1874627750279168:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785003.695891:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787785003.695928:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e11354d-250d-4393-8e0e-7593eb008ce7:3644:1874627750279168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787785003.695937:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e11354d-250d-4393-8e0e-7593eb008ce7:3644:1874627750279040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787785003.698529:0:25699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3386580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25699:1874627750278144:192.168.202.41@tcp:104: 00000100:00100000:0.0:1787785003.699756:0:25699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c33870c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25699:1874627750278272:192.168.202.41@tcp:104: 00010000:00010000:0.0:1787785003.699886:0:25699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8951c151f200/0x88ace7295d9ecdc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787785003.700576:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785003.700909:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728142208 00000100:00100000:3.0:1787785003.700936:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728142208 00010000:00010000:3.0:1787785003.700980:0:22657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951fda12c00/0x88ace7295d9ecab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7300b expref: 13 pid: 22663 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787785003.701027:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:3.0:1787785003.701038:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d2477c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c1bb492-200e-444d-8679-4c80592d7d80+13:2406:x1874627728142208:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787785003.701065:0:22657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787785003.701072:0:22657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951fda12c00/0x88ace7295d9ecab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7300b expref: 13 pid: 22663 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785003.701085:0:22657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951fda12c00/0x88ace7295d9ecab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7300b expref: 13 pid: 22663 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785003.701113:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951fda12c00/0x88ace7295d9ecab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7300b expref: 13 pid: 22663 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785003.701133:0:22657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787785003.701733:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d2477c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1c1bb492-200e-444d-8679-4c80592d7d80+12:2406:x1874627728142208:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 692us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785003.701743:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:2.0:1787785003.702714:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787785003.702818:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728142336 00000100:00100000:1.0:1787785003.702829:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728142336 00010000:00010000:1.0:1787785003.702869:0:22655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8951c151f600/0x88ace7295d9ec6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f9b expref: 12 pid: 22662 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787785003.702905:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:1.0:1787785003.702915:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12af840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c1bb492-200e-444d-8679-4c80592d7d80+12:2406:x1874627728142336:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787785003.702931:0:22655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787785003.702937:0:22655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8951c151f600/0x88ace7295d9ec6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f9b expref: 12 pid: 22662 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.702951:0:22655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8951c151f600/0x88ace7295d9ec6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f9b expref: 12 pid: 22662 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.702970:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c151f600/0x88ace7295d9ec6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72f9b expref: 12 pid: 22662 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.702993:0:22655:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8951c151f200/0x88ace7295d9ecdc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.703004:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c151f200/0x88ace7295d9ecdc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.703023:0:22655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951c151f200/0x88ace7295d9ecdc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.703031:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8951c151f200/0x88ace7295d9ecdc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.703068:0:22655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8951c151f200/0x88ace7295d9ecdc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.703077:0:22655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8951c151f200/0x88ace7295d9ecdc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.703084:0:22655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151f200 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787785003.703090:0:22655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8951c151f200/0x88ace7295d9ecdc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.703100:0:22655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8951c151f200/0x88ace7295d9ecdc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.703118:0:22655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8951c151f200/0x88ace7295d9ecdc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.703130:0:22655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787785003.703186:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12af840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1c1bb492-200e-444d-8679-4c80592d7d80+11:2406:x1874627728142336:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 271us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785003.703195:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 14 00010000:00010000:2.0:1787785003.704680:0:25699:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8951c151f200/0x88ace7295d9ecdc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785003.704702:0:25699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8951c151f200/0x88ace7295d9ecdc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785003.704709:0:25699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8951c151f200/0x88ace7295d9ecdc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785003.718249:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787785004.743259:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787785004.896682:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785004.913659:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728142464 00000100:00100000:3.0:1787785004.913684:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728142464 00000100:00100000:3.0:1787785004.913813:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 147 00000100:00100000:3.0:1787785004.913828:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1bb492-200e-444d-8679-4c80592d7d80+11:18077:x1874627728142464:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787785004.913853:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787785004.913882:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c151e400/0x88ace7295d9ece3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e73043 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785004.913936:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c151e400/0x88ace7295d9ece3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73043 expref: 12 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785004.913970:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c151e400/0x88ace7295d9ece3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73043 expref: 12 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785004.913982:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c151e400, rc 0) 00000100:00100000:3.0:1787785004.914080:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1bb492-200e-444d-8679-4c80592d7d80+12:18077:x1874627728142464:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 256us (17420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785004.914088:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 147 00000100:00100000:2.0:1787785004.925032:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785004.926235:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728142592 00000100:00100000:3.0:1787785004.926255:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728142592 00000100:00100000:3.0:1787785004.926419:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 148 00000100:00100000:3.0:1787785004.926433:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+12:18077:x1874627728142592:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787785004.927005:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+12:18077:x1874627728142592:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 572us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785004.927016:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 148 00000100:00100000:3.0:1787785004.936632:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785004.936737:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728142720 00000100:00100000:2.0:1787785004.936751:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728142720 00000100:00100000:2.0:1787785004.936857:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 149 00000100:00100000:2.0:1787785004.936870:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1bb492-200e-444d-8679-4c80592d7d80+12:18077:x1874627728142720:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787785004.937141:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1c1bb492-200e-444d-8679-4c80592d7d80+12:18077:x1874627728142720:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 Request processed in 273us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785004.937151:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 149 00000100:00100000:1.0:1787785004.954109:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785004.954850:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728142848 00000100:00100000:3.0:1787785004.954866:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728142848 00000100:00100000:3.0:1787785004.954958:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 150 00000100:00100000:3.0:1787785004.954971:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd37d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+12:18077:x1874627728142848:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787785004.954992:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787785004.955016:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c151e000/0x88ace7295d9ecea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4d8624697e7304a expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785004.955275:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c151e000/0x88ace7295d9ecea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7304a expref: 13 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785004.955313:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c151e000/0x88ace7295d9ecea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7304a expref: 13 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785004.955325:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c151e000, rc 0) 00000100:00100000:3.0:1787785004.955427:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd37d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+13:18077:x1874627728142848:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 458us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785004.955436:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 150 00000100:00100000:3.0:1787785004.987029:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787785004.987267:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728142976 00000100:00100000:0.0:1787785004.987281:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728142976 00000100:00100000:0.0:1787785004.987357:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 151 00000100:00100000:0.0:1787785004.987371:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1bb492-200e-444d-8679-4c80592d7d80+13:18077:x1874627728142976:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787785004.987632:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1bb492-200e-444d-8679-4c80592d7d80+13:18077:x1874627728142976:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 263us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787785004.987641:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 151 00000100:00100000:0.0:1787785004.992073:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785004.992277:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728143104 00000100:00100000:3.0:1787785004.992290:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728143104 00000100:00100000:3.0:1787785004.992360:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 152 00000100:00100000:3.0:1787785004.992371:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+13:18077:x1874627728143104:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787785004.993584:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+13:18077:x1874627728143104:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 Request processed in 1203us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785004.993601:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 152 00000100:00100000:1.0:1787785005.243995:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785005.244530:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728143232 00000100:00100000:3.0:1787785005.244546:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728143232 00000100:00100000:3.0:1787785005.245646:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:3.0:1787785005.245669:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:18701:x1874627728143232:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787785005.245701:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787785005.245739:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fa00/0x88ace7295d9ecf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e73051 expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.245855:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9ecf8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.245895:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9ecf8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.245924:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9ecf8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.245943:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ecff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.245951:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ecff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.245957:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ecff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.246059:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fc00/0x88ace7295d9ed06 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.246067:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fc00/0x88ace7295d9ed06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.246074:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fc00/0x88ace7295d9ed06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787785005.246110:0:22669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787785005.246115:0:22669:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787785005.246163:0:22669:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fc00/0x88ace7295d9ed06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.246176:0:22669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9ecf8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.246198:0:22669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9ecf8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.246206:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9ecf8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.246213:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151f200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787785005.246218:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9ecf8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.246226:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9ecf8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.246243:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128900) 00010000:00010000:3.0:1787785005.246246:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787785005.246252:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9ecf8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.246259:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9ecf8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.246278:0:22669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ecff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.246283:0:22669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ecff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.246289:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ecff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.246294:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151f600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787785005.246304:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ecff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.246311:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ecff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.246318:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8951f512bb00) 00010000:00010000:3.0:1787785005.246321:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787785005.246324:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ecff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.246329:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ecff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.246372:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fa00/0x88ace7295d9ecf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73051 expref: 8 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.246403:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151fc00/0x88ace7295d9ed06 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73051 expref: 7 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.246411:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8951f512be00) 00010000:00010000:3.0:1787785005.246413:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787785005.246416:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c151fc00, rc 0) 00000100:00100000:3.0:1787785005.246528:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+7:18701:x1874627728143232:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 868us (2549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785005.246537:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00080000:0.0:1787785005.249819:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787785005.252253:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785005.252358:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728143360 00000100:00100000:3.0:1787785005.252374:0:22680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728143360 00000100:00100000:3.0:1787785005.252939:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:3.0:1787785005.252952:0:22680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+7:18701:x1874627728143360:12345-192.168.202.41@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787785005.253072:0:22680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+7:18701:x1874627728143360:12345-192.168.202.41@tcp:900:lhsmtool_posix.0 Request processed in 122us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785005.253080:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:1.0:1787785005.259907:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787785005.260082:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728143616 00000100:00100000:0.0:1787785005.260096:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728143616 00000100:00100000:0.0:1787785005.260173:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:0.0:1787785005.260186:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+7:18701:x1874627728143616:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787785005.260215:0:22671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787785005.260260:0:22671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12200/0x88ace7295d9ed0d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e73058 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.260366:0:22671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12000/0x88ace7295d9ed14 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.260400:0:22671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12000/0x88ace7295d9ed14 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.260416:0:22671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12000/0x88ace7295d9ed14 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.260436:0:22671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12600/0x88ace7295d9ed1b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.260443:0:22671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12600/0x88ace7295d9ed1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.260450:0:22671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12600/0x88ace7295d9ed1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.261718:0:22671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13000/0x88ace7295d9ed22 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.261753:0:22671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13000/0x88ace7295d9ed22 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.261802:0:22671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13000/0x88ace7295d9ed22 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787785005.261818:0:22671:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787785005.262428:0:22671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12000/0x88ace7295d9ed14 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.262448:0:22671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12000/0x88ace7295d9ed14 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.262456:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12000/0x88ace7295d9ed14 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.262473:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951fda12000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787785005.262479:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12000/0x88ace7295d9ed14 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.263317:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12000/0x88ace7295d9ed14 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.263347:0:22671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8951f512be00) 00010000:00010000:0.0:1787785005.263351:0:22671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787785005.263358:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12000/0x88ace7295d9ed14 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.263365:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12000/0x88ace7295d9ed14 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.263402:0:22671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12600/0x88ace7295d9ed1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.263408:0:22671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12600/0x88ace7295d9ed1b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.263414:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12600/0x88ace7295d9ed1b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.263419:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951fda12600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787785005.263435:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12600/0x88ace7295d9ed1b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.263443:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12600/0x88ace7295d9ed1b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.263453:0:22671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8950c23c7400) 00010000:00010000:0.0:1787785005.263662:0:22671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787785005.263668:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12600/0x88ace7295d9ed1b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.263674:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12600/0x88ace7295d9ed1b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.267818:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12200/0x88ace7295d9ed0d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73058 expref: 10 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.267860:0:22671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13000/0x88ace7295d9ed22 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73058 expref: 9 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.267871:0:22671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8950c23c7100) 00010000:00010000:0.0:1787785005.267874:0:22671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787785005.267878:0:22671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951fda13000, rc 0) 00000100:00100000:0.0:1787785005.267986:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+9:18701:x1874627728143616:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 7801us (8095us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1787785005.267996:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:1.0:1787785005.274186:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787785005.280168:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728143744 00000100:00100000:0.0:1787785005.280189:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728143744 00000100:00100000:2.0:1787785005.282890:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:2.0:1787785005.282940:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+9:18701:x1874627728143744:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787785005.283295:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+9:18701:x1874627728143744:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 Request processed in 358us (9124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785005.283306:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:2.0:1787785005.286155:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787785005.287258:0:25465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728143872 00000100:00100000:1.0:1787785005.287275:0:25465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728143872 00000100:00080000:0.0:1787785005.287354:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787785005.288262:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:3.0:1787785005.288281:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+5:18701:x1874627728143872:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1787785005.295650:0:22671:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 7320us 10000000:01000000:1.0:1787785005.330351:0:22668:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787785005.330371:0:22668:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951fa9c6000 from 13 10000000:01000000:1.0:1787785005.330387:0:22668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787785005.330437:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df603800/0x88ace7295d9ed30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.330451:0:22668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951df603800/0x88ace7295d9ed30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.330462:0:22668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951df603800/0x88ace7295d9ed30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787785005.330490:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750279424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787785005.330565:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787785005.330693:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d1db7180 going to sleep for 11 seconds 00000100:00100000:2.0:1787785005.337649:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750279424 00000100:00100000:2.0:1787785005.337666:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750279424 00000100:00100000:2.0:1787785005.337741:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787785005.337751:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+20:22668:x1874627750279424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787785005.337784:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787785005.337804:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951d1629c00/0x88ace7295d9ed37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9ed30 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785005.337835:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951d1629c00/0x88ace7295d9ed37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9ed30 expref: 21 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785005.337846:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951d1629c00/0x88ace7295d9ed37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ed30 expref: 21 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785005.337856:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629c00, rc 0) 00000100:00100000:2.0:1787785005.337951:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+21:22668:x1874627750279424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (7385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785005.337958:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787785005.338147:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750279424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787785005.338168:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951df603800/0x88ace7295d9ed30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ed37 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.338178:0:22668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951df603800/0x88ace7295d9ed30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9ed37 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787785005.338256:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750279552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787785005.338287:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787785005.338323:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d1db7180 going to sleep for 11 seconds 00000100:00100000:3.0:1787785005.338462:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750279552 00000100:00100000:3.0:1787785005.338467:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750279552 00000100:00100000:3.0:1787785005.338502:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787785005.338509:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+21:22668:x1874627750279552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787785005.338627:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+21:22668:x1874627750279552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785005.338634:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787785005.338826:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750279552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787785005.338852:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750279680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787785005.338895:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787785005.338928:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d1db7180 going to sleep for 11 seconds 00000100:00100000:1.0:1787785005.338945:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750279680 00000100:00100000:1.0:1787785005.338948:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750279680 00000100:00100000:1.0:1787785005.338965:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787785005.338970:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+21:22668:x1874627750279680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787785005.339035:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+21:22668:x1874627750279680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785005.339041:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787785005.339074:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750279680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787785005.340553:0:25713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787785005.344488:0:22668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787785005.344532:0:22668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787785005.344545:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df603800/0x88ace7295d9ed30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ed37 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.344558:0:22668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951df603800/0x88ace7295d9ed30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ed37 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787785005.345316:0:22668:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787785005.345320:0:22668:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951ebf32800 from 13 10000000:01000000:0.0:1787785005.345325:0:22668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787785005.345373:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951fda12200/0x88ace7295d9ed3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.345394:0:22668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951fda12200/0x88ace7295d9ed3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.345405:0:22668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951fda12200/0x88ace7295d9ed3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787785005.345436:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c34103c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750279808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787785005.345509:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787785005.345562:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3685e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787785005.345627:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750279808 00000100:00100000:3.0:1787785005.345636:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750279808 00000100:00100000:3.0:1787785005.345705:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787785005.345716:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+21:22668:x1874627750279808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787785005.345729:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787785005.345743:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951c151fa00/0x88ace7295d9ed45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9ed3e expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.345801:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951c151fa00/0x88ace7295d9ed45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9ed3e expref: 22 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.345811:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951c151fa00/0x88ace7295d9ed45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ed3e expref: 22 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.345820:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c151fa00, rc 0) 00000100:00100000:3.0:1787785005.345863:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+22:22668:x1874627750279808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785005.345871:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787785005.346087:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c34103c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750279808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787785005.346102:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951fda12200/0x88ace7295d9ed3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ed45 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.346111:0:22668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951fda12200/0x88ace7295d9ed3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9ed45 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787785005.346169:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c34103c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750279936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787785005.346196:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787785005.346225:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3685e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787785005.346283:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750279936 00000100:00100000:3.0:1787785005.346289:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750279936 00000100:00100000:3.0:1787785005.346328:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787785005.346334:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+22:22668:x1874627750279936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787785005.346448:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+22:22668:x1874627750279936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785005.346454:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787785005.346525:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c34103c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750279936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787785005.346553:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c34103c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750280064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787785005.346605:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787785005.346626:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3685e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787785005.346673:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750280064 00000100:00100000:3.0:1787785005.346745:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750280064 00000100:00100000:3.0:1787785005.346841:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787785005.346849:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+22:22668:x1874627750280064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787785005.346939:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+22:22668:x1874627750280064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785005.346946:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787785005.347186:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c34103c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750280064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787785005.349394:0:25714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787785005.351249:0:22668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787785005.351286:0:22668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787785005.351298:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951fda12200/0x88ace7295d9ed3e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ed45 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.351311:0:22668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951fda12200/0x88ace7295d9ed3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ed45 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787785005.352909:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+5:18701:x1874627728143872:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 Request processed in 64612us (66746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785005.352925:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 26 10000000:01000000:1.0:1787785005.355742:0:22668:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787785005.355749:0:22668:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951f81b5800 from 13 10000000:01000000:1.0:1787785005.355754:0:22668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787785005.355998:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df602800/0x88ace7295d9ed4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.356012:0:22668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951df602800/0x88ace7295d9ed4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.356023:0:22668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951df602800/0x88ace7295d9ed4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787785005.356047:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750280192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787785005.356107:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787785005.356185:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d1db7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787785005.356226:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750280192 00000100:00100000:0.0:1787785005.356234:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750280192 00000100:00100000:0.0:1787785005.356410:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787785005.356421:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+22:22668:x1874627750280192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787785005.356435:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787785005.356449:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951fda12600/0x88ace7295d9ed53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9ed4c expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.356474:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951fda12600/0x88ace7295d9ed53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9ed4c expref: 23 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.356484:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951fda12600/0x88ace7295d9ed53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ed4c expref: 23 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.356493:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951fda12600, rc 0) 00000100:00100000:1.0:1787785005.370305:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+23:22668:x1874627750280192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 13876us (14187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785005.370319:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787785005.370874:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750280192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787785005.370967:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951df602800/0x88ace7295d9ed4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ed53 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.370996:0:22668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951df602800/0x88ace7295d9ed4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9ed53 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787785005.371082:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c34103c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750280320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787785005.371128:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787785005.371160:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3685e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787785005.371322:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750280320 00000100:00100000:3.0:1787785005.371329:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750280320 00000100:00100000:3.0:1787785005.371394:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787785005.371404:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+23:22668:x1874627750280320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787785005.374041:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+23:22668:x1874627750280320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2630us (2904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785005.374057:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787785005.374194:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c34103c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750280320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787785005.374278:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951ff47c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750280448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787785005.374343:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787785005.374403:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d1db7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787785005.374479:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750280448 00000100:00100000:0.0:1787785005.374487:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750280448 00000100:00100000:0.0:1787785005.374524:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787785005.374533:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+23:22668:x1874627750280448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787785005.374655:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+23:22668:x1874627750280448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787785005.374662:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787785005.375294:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951ff47c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750280448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787785005.378206:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787785005.379013:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728144000 00000100:00100000:0.0:1787785005.379025:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728144000 00000100:00100000:0.0:1787785005.379097:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:0.0:1787785005.379109:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+9:18707:x1874627728144000:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1787785005.379132:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787785005.379155:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12000/0x88ace7295d9ed5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e7305f expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.379221:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12c00/0x88ace7295d9ed61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.379236:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12c00/0x88ace7295d9ed61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.379269:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12c00/0x88ace7295d9ed61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.379299:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09600/0x88ace7295d9ed68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.379307:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09600/0x88ace7295d9ed68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.379313:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09600/0x88ace7295d9ed68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.379360:0:22670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12c00/0x88ace7295d9ed61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.379367:0:22670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12c00/0x88ace7295d9ed61 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.379373:0:22670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12c00/0x88ace7295d9ed61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.379391:0:22670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951fda12c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787785005.379395:0:22670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12c00/0x88ace7295d9ed61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.379401:0:22670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12c00/0x88ace7295d9ed61 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.379412:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128900) 00010000:00010000:0.0:1787785005.379415:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787785005.379419:0:22670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12c00/0x88ace7295d9ed61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.379429:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12c00/0x88ace7295d9ed61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.379446:0:22670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09600/0x88ace7295d9ed68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.379451:0:22670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09600/0x88ace7295d9ed68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.379456:0:22670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09600/0x88ace7295d9ed68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.379461:0:22670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951fda09600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787785005.379464:0:22670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09600/0x88ace7295d9ed68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.379469:0:22670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09600/0x88ace7295d9ed68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.379476:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8950c23c7400) 00010000:00010000:0.0:1787785005.379479:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787785005.379481:0:22670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09600/0x88ace7295d9ed68 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.379486:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09600/0x88ace7295d9ed68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.379528:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12000/0x88ace7295d9ed5a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7305f expref: 10 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.379549:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128900) 00010000:00010000:0.0:1787785005.379551:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787785005.379554:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda12000/0x88ace7295d9ed5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7305f expref: 10 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.379563:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951fda12000, rc 0) 00000100:00100000:0.0:1787785005.379640:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+9:18707:x1874627728144000:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 533us (1444us total) trans 0 rc 301/301 00000100:00100000:0.0:1787785005.379648:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 27 00000040:00080000:3.0:1787785005.381163:0:25715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787785005.381896:0:22668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787785005.381924:0:22668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787785005.381937:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df602800/0x88ace7295d9ed4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ed53 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.381949:0:22668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951df602800/0x88ace7295d9ed4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ed53 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787785005.381960:0:22668:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787785005.381963:0:22668:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8951ff20c000 from 13 10000000:01000000:1.0:1787785005.381966:0:22668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787785005.382000:0:22668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df603c00/0x88ace7295d9ed6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.382009:0:22668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff8951df603c00/0x88ace7295d9ed6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.382020:0:22668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff8951df603c00/0x88ace7295d9ed6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787785005.382043:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c32721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750280576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787785005.382099:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787785005.382134:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d1db7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787785005.382629:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750280576 00000100:00100000:0.0:1787785005.382637:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750280576 00000100:00100000:1.0:1787785005.383584:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787785005.383601:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+23:22668:x1874627750280576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787785005.383628:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787785005.383645:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8951df602a00/0x88ace7295d9ed76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x88ace7295d9ed6f expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.383674:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8951df602a00/0x88ace7295d9ed76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88ace7295d9ed6f expref: 24 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.385059:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8951df602a00/0x88ace7295d9ed76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88ace7295d9ed6f expref: 24 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.385071:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df602a00, rc 0) 00000100:00100000:1.0:1787785005.385159:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+24:22668:x1874627750280576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1564us (3059us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785005.385168:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787785005.385354:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c32721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750280576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787785005.385385:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff8951df603c00/0x88ace7295d9ed6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ed76 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.385395:0:22668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff8951df603c00/0x88ace7295d9ed6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88ace7295d9ed76 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787785005.385480:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3410780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750280704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787785005.385534:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787785005.385627:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8950c3685780 going to sleep for 11 seconds 00000100:00100000:2.0:1787785005.386063:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750280704 00000100:00100000:2.0:1787785005.386070:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750280704 00000100:00100000:2.0:1787785005.386144:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787785005.386154:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+24:22668:x1874627750280704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787785005.386283:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e11354d-250d-4393-8e0e-7593eb008ce7+24:22668:x1874627750280704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785005.386291:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787785005.386346:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3410780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750280704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787785005.386393:0:22668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c32730c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750280832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787785005.386438:0:22668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787785005.386509:0:22668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d1db7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787785005.386646:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750280832 00000100:00100000:0.0:1787785005.386650:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750280832 00000100:00100000:0.0:1787785005.386672:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787785005.386688:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c4d48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+24:22668:x1874627750280832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787785005.386808:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c4d48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e11354d-250d-4393-8e0e-7593eb008ce7+24:22668:x1874627750280832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787785005.386821:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787785005.386913:0:22668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c32730c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e11354d-250d-4393-8e0e-7593eb008ce7:22668:1874627750280832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787785005.388348:0:25716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787785005.388536:0:22668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787785005.388557:0:22668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787785005.388568:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff8951df603c00/0x88ace7295d9ed6f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ed76 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.388580:0:22668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff8951df603c00/0x88ace7295d9ed6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88ace7295d9ed76 expref: -99 pid: 22668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787785005.395987:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785005.397136:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728144128 00000100:00100000:3.0:1787785005.397149:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728144128 00000100:00100000:3.0:1787785005.397208:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:3.0:1787785005.397218:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c32730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+9:18707:x1874627728144128:12345-192.168.202.41@tcp:700:lfs.0 00000100:00100000:3.0:1787785005.397313:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c32730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+9:18707:x1874627728144128:12345-192.168.202.41@tcp:700:lfs.0 Request processed in 96us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785005.397321:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:1.0:1787785005.401586:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785005.402751:0:25465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728144384 00000100:00100000:3.0:1787785005.402779:0:25465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728144384 00000100:00100000:3.0:1787785005.402845:0:25465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:3.0:1787785005.402856:0:25465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+9:18707:x1874627728144384:12345-192.168.202.41@tcp:36:lfs.0 00010000:00010000:3.0:1787785005.402922:0:25465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787785005.402950:0:25465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13600/0x88ace7295d9ec96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e72fcc expref: 9 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.402971:0:25465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128900) 00010000:00010000:3.0:1787785005.402977:0:25465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787785005.403038:0:25465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ed7d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.403052:0:25465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13a00/0x88ace7295d9ecd5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7303c expref: 5 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.403077:0:25465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ed7d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.403115:0:25465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13a00/0x88ace7295d9ecd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7303c expref: 5 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.403127:0:25465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13a00/0x88ace7295d9ecd5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7303c expref: 5 pid: 22670 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787785005.403142:0:25465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3384f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25465:1874627750280960:192.168.202.41@tcp:104: 00000100:00100000:3.0:1787785005.403233:0:25465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c2e7acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787785005.407310:0:25465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3384f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25465:1874627750280960:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787785005.407339:0:25465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ed7d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787785005.410423:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785005.410565:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728144512 00000100:00100000:2.0:1787785005.410574:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728144512 00010000:00010000:2.0:1787785005.410646:0:22657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13a00/0x88ace7295d9ecd5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7303c expref: 6 pid: 22670 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787785005.410693:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:2.0:1787785005.410703:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3384f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:2406:x1874627728144512:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787785005.410719:0:22657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787785005.410726:0:22657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13a00/0x88ace7295d9ecd5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7303c expref: 6 pid: 22670 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785005.410740:0:22657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13a00/0x88ace7295d9ecd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7303c expref: 6 pid: 22670 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785005.410792:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda13a00/0x88ace7295d9ecd5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7303c expref: 6 pid: 22670 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785005.410810:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128900) 00010000:00010000:2.0:1787785005.410815:0:22657:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ed7d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785005.410839:0:22657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ed7d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785005.410847:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ed7d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785005.410871:0:22657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787785005.410933:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3384f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:315a9816-a5f4-4529-af39-1b0e9b8aed4e+5:2406:x1874627728144512:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 231us (520us total) trans 0 rc 0/0 00010000:00010000:3.0:1787785005.410936:0:25465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ed7d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787785005.410940:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 15 00010000:00010000:3.0:1787785005.410944:0:25465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ed7d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.410967:0:25465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9ed84 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.410977:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9ed84 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.410994:0:25465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9ed84 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787785005.411078:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787785005.413556:0:25465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713000/0x88ace7295d9ed8b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.413578:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713000/0x88ace7295d9ed8b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.413663:0:25465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713000/0x88ace7295d9ed8b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787785005.413685:0:25465:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcb130c7 reply state 00000000a135edbe transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713000/0x88ace7295d9ed8b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.413697:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713000/0x88ace7295d9ed8b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.413705:0:25465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8951f512b400) 00010000:00010000:3.0:1787785005.413708:0:25465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787785005.413712:0:25465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787785005.413718:0:25465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787785005.413726:0:25465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ed7d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.413733:0:25465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ed7d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.413740:0:25465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ed7d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.413746:0:25465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151f600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787785005.413757:0:25465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ed7d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.413764:0:25465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ed7d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.413790:0:25465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8951f5128900) 00010000:00010000:3.0:1787785005.413793:0:25465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787785005.413797:0:25465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ed7d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.413803:0:25465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f600/0x88ace7295d9ed7d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787785005.413821:0:25465:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcb130c7 reply state 00000000a135edbe transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9ed84 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.413829:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9ed84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.413835:0:25465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8951f512bb00) 00010000:00010000:3.0:1787785005.413837:0:25465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787785005.413839:0:25465:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787785005.413978:0:25465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+10:18707:x1874627728144384:12345-192.168.202.41@tcp:36:lfs.0 Request processed in 11119us (12397us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1787785005.413987:0:25465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:3.0:1787785005.534516:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787785005.534646:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728144640 00000100:00100000:0.0:1787785005.534657:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728144640 00000100:00100000:0.0:1787785005.534725:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:0.0:1787785005.534736:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3385a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+10:18716:x1874627728144640:12345-192.168.202.41@tcp:101:lctl.0 00010000:00010000:0.0:1787785005.534759:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787785005.534832:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09e00/0x88ace7295d9ed92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e73066 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.534898:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08000/0x88ace7295d9ed99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.534914:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08000/0x88ace7295d9ed99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.534926:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08000/0x88ace7295d9ed99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787785005.534971:0:22670:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787785005.534974:0:22670:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787785005.535041:0:22670:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08000/0x88ace7295d9ed99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.535067:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09e00/0x88ace7295d9ed92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73066 expref: 12 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.535086:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08000/0x88ace7295d9ed99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73066 expref: 11 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.535094:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8950c23c7400) 00010000:00010000:0.0:1787785005.535097:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787785005.535100:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951fda08000, rc 0) 00000100:00100000:0.0:1787785005.535152:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3385a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+11:18716:x1874627728144640:12345-192.168.202.41@tcp:101:lctl.0 Request processed in 418us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787785005.535159:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:0.0:1787785005.596900:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785005.597004:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728144768 00000100:00100000:2.0:1787785005.597014:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728144768 00000100:00100000:2.0:1787785005.597081:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:2.0:1787785005.597092:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3411e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:315a9816-a5f4-4529-af39-1b0e9b8aed4e+5:18717:x1874627728144768:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787785005.597115:0:22671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787785005.597141:0:22671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9eda0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e7306d expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785005.597209:0:22671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9eda7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785005.597222:0:22671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9eda7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785005.597232:0:22671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9eda7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787785005.597283:0:22671:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787785005.597287:0:22671:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787785005.597327:0:22671:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9eda7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785005.597353:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9eda0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7306d expref: 7 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785005.597373:0:22671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628c00/0x88ace7295d9eda7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7306d expref: 6 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785005.597392:0:22671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8950c23c7400) 00010000:00010000:2.0:1787785005.597395:0:22671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787785005.597399:0:22671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628c00, rc 0) 00000100:00100000:2.0:1787785005.597467:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3411e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:18717:x1874627728144768:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 376us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785005.597474:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:2.0:1787785005.606747:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787785005.606885:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728144896 00000100:00100000:1.0:1787785005.606895:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728144896 00000100:00100000:1.0:1787785005.606962:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:1.0:1787785005.606983:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:18717:x1874627728144896:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:1.0:1787785005.607005:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787785005.607030:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603000/0x88ace7295d9edae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e73074 expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607092:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9edb5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607107:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9edb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607118:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9edb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607129:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9edbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607136:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9edbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607142:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9edbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607220:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031800/0x88ace7295d9edc3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607229:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031800/0x88ace7295d9edc3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607237:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031800/0x88ace7295d9edc3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787785005.607287:0:22669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787785005.607290:0:22669:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787785005.607312:0:22669:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031800/0x88ace7295d9edc3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607324:0:22669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9edb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607330:0:22669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9edb5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607336:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9edb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607342:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787785005.607345:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9edb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607353:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9edb5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607366:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8950c23c7400) 00010000:00010000:1.0:1787785005.607369:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787785005.607385:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9edb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607392:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9edb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607405:0:22669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9edbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607422:0:22669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9edbc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607429:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9edbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607435:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787785005.607438:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9edbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607445:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9edbc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607453:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8951f512bb00) 00010000:00010000:1.0:1787785005.607456:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787785005.607460:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9edbc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607465:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9edbc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607491:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603000/0x88ace7295d9edae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73074 expref: 8 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607504:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031800/0x88ace7295d9edc3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73074 expref: 7 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.607512:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8951f512b400) 00010000:00010000:1.0:1787785005.607514:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787785005.607523:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c0031800, rc 0) 00000100:00100000:1.0:1787785005.607595:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:315a9816-a5f4-4529-af39-1b0e9b8aed4e+7:18717:x1874627728144896:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 613us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785005.607602:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:0.0:1787785005.625706:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787785005.625835:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728145024 00000100:00100000:1.0:1787785005.625845:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728145024 00000100:00100000:1.0:1787785005.625921:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:1.0:1787785005.625932:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3412940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+5:18717:x1874627728145024:12345-192.168.202.41@tcp:900:lfs.0 00000100:00100000:1.0:1787785005.626024:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3412940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+5:18717:x1874627728145024:12345-192.168.202.41@tcp:900:lfs.0 Request processed in 94us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785005.626041:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00080000:0.0:1787785005.626611:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787785005.635665:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787785005.635815:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728145280 00000100:00100000:0.0:1787785005.635826:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728145280 00000100:00100000:0.0:1787785005.635889:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 32 00000100:00100000:0.0:1787785005.635901:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:315a9816-a5f4-4529-af39-1b0e9b8aed4e+7:18717:x1874627728145280:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1787785005.635923:0:22671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787785005.635946:0:22671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09800/0x88ace7295d9edca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e7307b expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787785005.636192:0:22671:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787785005.636302:0:22671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09800/0x88ace7295d9edca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7307b expref: 9 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.636336:0:22671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8950c23c7400) 00010000:00010000:0.0:1787785005.636339:0:22671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787785005.636344:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09800/0x88ace7295d9edca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7307b expref: 9 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.636359:0:22671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951fda09800, rc 0) 00000100:00100000:0.0:1787785005.636481:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:315a9816-a5f4-4529-af39-1b0e9b8aed4e+8:18717:x1874627728145280:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 582us (824us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1787785005.636488:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 32 00000100:00100000:2.0:1787785005.656674:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787785005.659156:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728145536 00000100:00100000:1.0:1787785005.659171:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728145536 00000100:00100000:1.0:1787785005.659310:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:1.0:1787785005.659322:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:315a9816-a5f4-4529-af39-1b0e9b8aed4e+8:18717:x1874627728145536:12345-192.168.202.41@tcp:36:lfs.0 00010000:00010000:1.0:1787785005.659390:0:22669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787785005.659417:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031800/0x88ace7295d9edc3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73074 expref: 8 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.659438:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8951f512b400) 00010000:00010000:1.0:1787785005.659443:0:22669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787785005.659663:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030200/0x88ace7295d9edd8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.659679:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030200/0x88ace7295d9edd8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.659689:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030200/0x88ace7295d9edd8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787785005.659939:0:22669:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000899281ca reply state 00000000342e2cc4 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030200/0x88ace7295d9edd8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.659952:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030200/0x88ace7295d9edd8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.659958:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8951f512b400) 00010000:00010000:1.0:1787785005.659960:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1787785005.659963:0:22669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787785005.659971:0:22669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787785005.660140:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:315a9816-a5f4-4529-af39-1b0e9b8aed4e+9:18717:x1874627728145536:12345-192.168.202.41@tcp:36:lfs.0 Request processed in 819us (3475us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1787785005.660148:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:3.0:1787785005.664017:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785005.664174:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728145792 00000100:00100000:2.0:1787785005.664184:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728145792 00000100:00100000:2.0:1787785005.664240:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:2.0:1787785005.664262:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3385680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+9:18717:x1874627728145792:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:2.0:1787785005.664519:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3385680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+10:18717:x1874627728145792:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 269us (510us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1787785005.664528:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:3.0:1787785005.668476:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787785005.668696:0:25465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728146048 00000100:00100000:0.0:1787785005.668706:0:25465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728146048 00000100:00100000:0.0:1787785005.668796:0:25465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:0.0:1787785005.668808:0:25465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3386d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:315a9816-a5f4-4529-af39-1b0e9b8aed4e+10:18717:x1874627728146048:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1787785005.668832:0:25465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787785005.668855:0:25465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09800/0x88ace7295d9eddf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e73082 expref: -99 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.668932:0:25465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08400/0x88ace7295d9ede6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.668946:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08400/0x88ace7295d9ede6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.668956:0:25465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08400/0x88ace7295d9ede6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.668965:0:25465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09c00/0x88ace7295d9eded lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.668986:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09c00/0x88ace7295d9eded lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.668994:0:25465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09c00/0x88ace7295d9eded lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787785005.669210:0:25465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787785005.669350:0:25465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08400/0x88ace7295d9ede6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.669359:0:25465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08400/0x88ace7295d9ede6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.669365:0:25465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08400/0x88ace7295d9ede6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.669371:0:25465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951fda08400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787785005.669385:0:25465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08400/0x88ace7295d9ede6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.669392:0:25465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08400/0x88ace7295d9ede6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.669404:0:25465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8950c23c7400) 00010000:00010000:0.0:1787785005.669407:0:25465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787785005.669411:0:25465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08400/0x88ace7295d9ede6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.669418:0:25465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08400/0x88ace7295d9ede6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.669443:0:25465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09c00/0x88ace7295d9eded lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.669449:0:25465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09c00/0x88ace7295d9eded lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.669711:0:25465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09c00/0x88ace7295d9eded lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.669719:0:25465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951fda09c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787785005.669722:0:25465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09c00/0x88ace7295d9eded lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.669728:0:25465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09c00/0x88ace7295d9eded lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.669737:0:25465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8951f512bb00) 00010000:00010000:0.0:1787785005.669739:0:25465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787785005.669742:0:25465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09c00/0x88ace7295d9eded lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.669748:0:25465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09c00/0x88ace7295d9eded lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.669992:0:25465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09800/0x88ace7295d9eddf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73082 expref: 12 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.670004:0:25465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8950c23c7400) 00010000:00010000:0.0:1787785005.670006:0:25465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787785005.670020:0:25465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09800/0x88ace7295d9eddf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73082 expref: 12 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.670042:0:25465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951fda09800, rc 0) 00000100:00100000:0.0:1787785005.670116:0:25465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3386d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:315a9816-a5f4-4529-af39-1b0e9b8aed4e+11:18717:x1874627728146048:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1310us (1657us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1787785005.670124:0:25465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:0.0:1787785005.674671:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787785005.674795:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728146176 00000100:00100000:1.0:1787785005.674805:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728146176 00000100:00100000:1.0:1787785005.674876:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:1.0:1787785005.674886:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3412d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+11:18717:x1874627728146176:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:1.0:1787785005.674910:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787785005.674932:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031800/0x88ace7295d9edfb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e73089 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.675044:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9ee02 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.675058:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9ee02 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.675070:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9ee02 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787785005.675114:0:22670:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787785005.675118:0:22670:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787785005.675137:0:22670:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9ee02 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.675163:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031800/0x88ace7295d9edfb lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73089 expref: 13 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.675180:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9ee02 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73089 expref: 12 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.675188:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8951f512b400) 00010000:00010000:1.0:1787785005.675191:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787785005.675194:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c0030400, rc 0) 00000100:00100000:1.0:1787785005.675902:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3412d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+12:18717:x1874627728146176:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1013us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785005.675910:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:1.0:1787785005.680884:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785005.681055:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728146304 00000100:00100000:2.0:1787785005.681065:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728146304 00000100:00100000:2.0:1787785005.681118:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:2.0:1787785005.681144:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3270f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+12:18717:x1874627728146304:12345-192.168.202.41@tcp:37:lfs.0 00000100:00100000:2.0:1787785005.687872:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3270f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+12:18717:x1874627728146304:12345-192.168.202.41@tcp:37:lfs.0 Request processed in 6718us (6987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785005.687888:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:2.0:1787785005.698170:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785005.698387:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728146560 00000100:00100000:3.0:1787785005.698399:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728146560 00000100:00100000:3.0:1787785005.698548:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:3.0:1787785005.698559:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d8289850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:315a9816-a5f4-4529-af39-1b0e9b8aed4e+12:18717:x1874627728146560:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:3.0:1787785005.698967:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d8289850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:315a9816-a5f4-4529-af39-1b0e9b8aed4e+13:18717:x1874627728146560:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 409us (810us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1787785005.698976:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 4 00010000:00010000:1.0:1787785005.765956:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787785005.770268:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787785005.770700:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728146688 00000100:00100000:0.0:1787785005.770711:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728146688 00000100:00100000:0.0:1787785005.770802:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:0.0:1787785005.770813:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3273c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+11:18723:x1874627728146688:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:0.0:1787785005.770834:0:22671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787785005.770855:0:22671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09c00/0x88ace7295d9ee09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e73090 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.770919:0:22671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08400/0x88ace7295d9ee10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.770934:0:22671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08400/0x88ace7295d9ee10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.770946:0:22671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08400/0x88ace7295d9ee10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.770957:0:22671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08e00/0x88ace7295d9ee17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.770963:0:22671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08e00/0x88ace7295d9ee17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.770986:0:22671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08e00/0x88ace7295d9ee17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.771077:0:22671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08a00/0x88ace7295d9ee1e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.771086:0:22671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08a00/0x88ace7295d9ee1e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.771093:0:22671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08a00/0x88ace7295d9ee1e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787785005.771126:0:22671:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787785005.771129:0:22671:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787785005.771169:0:22671:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08a00/0x88ace7295d9ee1e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.771182:0:22671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08400/0x88ace7295d9ee10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.771187:0:22671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08400/0x88ace7295d9ee10 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.771194:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08400/0x88ace7295d9ee10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.771199:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951fda08400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787785005.771203:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08400/0x88ace7295d9ee10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.771209:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08400/0x88ace7295d9ee10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.771229:0:22671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8950c23c7400) 00010000:00010000:0.0:1787785005.771232:0:22671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787785005.771237:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08400/0x88ace7295d9ee10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.771244:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08400/0x88ace7295d9ee10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.771257:0:22671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08e00/0x88ace7295d9ee17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.771521:0:22671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08e00/0x88ace7295d9ee17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.771528:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08e00/0x88ace7295d9ee17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.771533:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951fda08e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787785005.771536:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08e00/0x88ace7295d9ee17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.771543:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08e00/0x88ace7295d9ee17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.771551:0:22671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8951f512bb00) 00010000:00010000:0.0:1787785005.771553:0:22671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787785005.771556:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08e00/0x88ace7295d9ee17 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.771562:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08e00/0x88ace7295d9ee17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.771602:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09c00/0x88ace7295d9ee09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73090 expref: 13 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.771615:0:22671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08a00/0x88ace7295d9ee1e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73090 expref: 12 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.771622:0:22671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8951f512b400) 00010000:00010000:0.0:1787785005.771625:0:22671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787785005.771627:0:22671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951fda08a00, rc 0) 00000100:00100000:0.0:1787785005.771698:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3273c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+12:18723:x1874627728146688:12345-192.168.202.41@tcp:101:bash.0 Request processed in 886us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787785005.771706:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:0.0:1787785005.779873:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787785005.779974:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728146816 00000100:00100000:1.0:1787785005.779983:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728146816 00000100:00100000:1.0:1787785005.780048:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:1.0:1787785005.780059:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c34130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+5:18723:x1874627728146816:12345-192.168.202.41@tcp:900:bash.0 00000100:00100000:1.0:1787785005.780160:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c34130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+5:18723:x1874627728146816:12345-192.168.202.41@tcp:900:bash.0 Request processed in 103us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785005.780169:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:2.0:1787785005.783951:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787785005.784121:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728147072 00000100:00100000:1.0:1787785005.784131:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728147072 00000100:00100000:1.0:1787785005.784230:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:1.0:1787785005.784241:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+12:18723:x1874627728147072:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:1.0:1787785005.784278:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787785005.784300:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031800/0x88ace7295d9ee25 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e73097 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.784418:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603000/0x88ace7295d9ee2c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.784433:0:22670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9ee02 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73089 expref: 12 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.784442:0:22670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603000/0x88ace7295d9ee2c lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.784487:0:22670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9ee02 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73089 expref: 12 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.784502:0:22670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9ee02 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73089 expref: 12 pid: 22670 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787785005.784515:0:22670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22670:1874627750281088:192.168.202.41@tcp:104: 00000100:00100000:1.0:1787785005.784605:0:22670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d1db7000 going to sleep for 11 seconds 00000100:00100000:2.0:1787785005.789500:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787785005.789822:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728147200 00000100:00100000:0.0:1787785005.789831:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728147200 00010000:00010000:0.0:1787785005.789873:0:22656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9ee02 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73089 expref: 13 pid: 22670 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787785005.789913:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:0.0:1787785005.789924:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e11e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+13:2405:x1874627728147200:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787785005.789938:0:22656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787785005.789946:0:22656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9ee02 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73089 expref: 13 pid: 22670 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.789959:0:22656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9ee02 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73089 expref: 13 pid: 22670 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.789999:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8951f512b400) 00010000:00010000:0.0:1787785005.790004:0:22656:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603000/0x88ace7295d9ee2c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.790013:0:22656:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603000/0x88ace7295d9ee2c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.790021:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603000/0x88ace7295d9ee2c lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785005.790051:0:22656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787785005.790112:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e11e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+13:2405:x1874627728147200:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 189us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787785005.790120:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00010000:00010000:1.0:1787785005.791792:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9ee02 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73089 expref: 12 pid: 22670 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787785005.791819:0:22670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c3272580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22670:1874627750281088:192.168.202.41@tcp:104: 00010000:00010000:1.0:1787785005.791859:0:22670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603000/0x88ace7295d9ee2c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.791870:0:22670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603000/0x88ace7295d9ee2c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.791877:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603000/0x88ace7295d9ee2c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.791901:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9ee33 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.791913:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9ee33 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.791921:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9ee33 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.794974:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9ee3a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.794997:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9ee3a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.795010:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9ee3a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787785005.795024:0:22670:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787785005.795064:0:22670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603000/0x88ace7295d9ee2c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.795072:0:22670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603000/0x88ace7295d9ee2c lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.795097:0:22670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603000/0x88ace7295d9ee2c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.795103:0:22670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df603000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787785005.795107:0:22670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603000/0x88ace7295d9ee2c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.795115:0:22670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603000/0x88ace7295d9ee2c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.795127:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8951f512b400) 00010000:00010000:1.0:1787785005.795130:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787785005.795135:0:22670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603000/0x88ace7295d9ee2c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.795141:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603000/0x88ace7295d9ee2c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787785005.795156:0:22670:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e1ebd84 reply state 000000003096d7dd transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9ee33 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.795166:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9ee33 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.795172:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8951c133c800) 00010000:00010000:1.0:1787785005.795174:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787785005.795177:0:22670:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787785005.795220:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031800/0x88ace7295d9ee25 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73097 expref: 15 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.795233:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9ee3a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73097 expref: 14 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785005.795257:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:1.0:1787785005.795266:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787785005.795268:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951df603400, rc 0) 00000100:00100000:1.0:1787785005.795337:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+15:18723:x1874627728147072:12345-192.168.202.41@tcp:101:bash.0 Request processed in 11099us (11396us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1787785005.795345:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:2.0:1787785005.816228:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785005.816482:0:25465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728147328 00000100:00100000:3.0:1787785005.816494:0:25465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728147328 00000100:00100000:3.0:1787785005.816620:0:25465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 38 00000100:00100000:3.0:1787785005.816631:0:25465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+15:18723:x1874627728147328:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:3.0:1787785005.816665:0:25465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787785005.816696:0:25465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9ee48 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e7309e expref: -99 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.816984:0:25465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9ee4f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.817000:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9ee4f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.817012:0:25465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9ee4f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787785005.817079:0:25465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787785005.817083:0:25465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787785005.817107:0:25465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9ee4f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.817117:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9ee4f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.817163:0:25465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9ee48 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7309e expref: 17 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.817181:0:25465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9ee4f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7309e expref: 16 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.817189:0:25465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:3.0:1787785005.817192:0:25465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787785005.817195:0:25465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713c00, rc 0) 00000100:00100000:3.0:1787785005.817588:0:25465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+16:18723:x1874627728147328:12345-192.168.202.41@tcp:101:bash.0 Request processed in 956us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785005.817596:0:25465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 38 00000100:00100000:1.0:1787785005.826643:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785005.827306:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728147584 00000100:00100000:2.0:1787785005.827317:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728147584 00000100:00100000:2.0:1787785005.827384:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:2.0:1787785005.827395:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3272580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+16:18723:x1874627728147584:12345-192.168.202.41@tcp:35:bash.0 00000100:00100000:2.0:1787785005.827714:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3272580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+17:18723:x1874627728147584:12345-192.168.202.41@tcp:35:bash.0 Request processed in 320us (1080us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1787785005.827723:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:2.0:1787785005.854984:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785005.855016:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785005.855059:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785005.855079:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785005.855127:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785005.855160:0:24684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728147968 00000100:00100000:2.0:1787785005.855169:0:24684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728147968 00000100:00100000:2.0:1787785005.855217:0:24684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728148224 00000100:00100000:2.0:1787785005.855220:0:24684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728148224 00000100:00100000:2.0:1787785005.855233:0:24684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728147840 00000100:00100000:2.0:1787785005.855235:0:24684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728147840 00000100:00100000:2.0:1787785005.855244:0:24684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728148096 00000100:00100000:2.0:1787785005.855270:0:24684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728148096 00000100:00100000:2.0:1787785005.855290:0:24684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:2.0:1787785005.855299:0:24684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e11a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+5:2408:x1874627728147968:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787785005.855382:0:24684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e11a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+5:2408:x1874627728147968:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 73us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785005.855390:0:24684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:2.0:1787785005.855407:0:24684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:2.0:1787785005.855414:0:24684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e12940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:315a9816-a5f4-4529-af39-1b0e9b8aed4e+5:2408:x1874627728148224:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787785005.855436:0:24684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e12940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:315a9816-a5f4-4529-af39-1b0e9b8aed4e+5:2408:x1874627728148224:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 23us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785005.855441:0:24684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:2.0:1787785005.855452:0:24684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:2.0:1787785005.855458:0:24684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+5:2408:x1874627728147840:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787785005.855480:0:24684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+5:2408:x1874627728147840:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 22us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785005.855485:0:24684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:2.0:1787785005.855496:0:24684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:2.0:1787785005.855501:0:24684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:315a9816-a5f4-4529-af39-1b0e9b8aed4e+5:2408:x1874627728148096:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787785005.855523:0:24684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:315a9816-a5f4-4529-af39-1b0e9b8aed4e+5:2408:x1874627728148096:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 21us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785005.855529:0:24684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00080000:0.0:1787785005.855715:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787785005.855721:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787785005.855734:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728147712 00000100:00100000:0.0:1787785005.855738:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728147712 00000100:00100000:0.0:1787785005.855806:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 165 00000100:00100000:0.0:1787785005.855813:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1bb492-200e-444d-8679-4c80592d7d80+13:2408:x1874627728147712:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1787785005.855849:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1c1bb492-200e-444d-8679-4c80592d7d80+13:2408:x1874627728147712:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 37us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787785005.855855:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 165 00000100:00100000:2.0:1787785005.944074:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785005.944169:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728148480 00000100:00100000:3.0:1787785005.944179:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728148480 00000100:00100000:3.0:1787785005.944249:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:3.0:1787785005.944269:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+17:18733:x1874627728148480:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1787785005.944295:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787785005.944317:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9ee56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e730a5 expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787785005.944431:0:22669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787785005.944542:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9ee56 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730a5 expref: 19 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.944556:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8950c23c7400) 00010000:00010000:3.0:1787785005.944559:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787785005.944579:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9ee56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730a5 expref: 19 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785005.944594:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712200, rc 0) 00000100:00100000:3.0:1787785005.944668:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+18:18733:x1874627728148480:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 410us (604us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1787785005.944676:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:0.0:1787785005.951595:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785005.951722:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728148736 00000100:00100000:2.0:1787785005.951734:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728148736 00000100:00100000:2.0:1787785005.951995:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:2.0:1787785005.952007:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3410780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+18:18733:x1874627728148736:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:2.0:1787785005.952274:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3410780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+19:18733:x1874627728148736:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 269us (690us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1787785005.952282:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:2.0:1787785006.005276:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787785006.005392:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728148992 00000100:00100000:0.0:1787785006.005409:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728148992 00000100:00100000:0.0:1787785006.005470:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 40 00000100:00100000:0.0:1787785006.005481:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+19:18736:x1874627728148992:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1787785006.005531:0:22671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787785006.005555:0:22671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09000/0x88ace7295d9ee64 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e730ac expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785006.005661:0:22671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08600/0x88ace7295d9ee6b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785006.005676:0:22671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08600/0x88ace7295d9ee6b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785006.005688:0:22671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08600/0x88ace7295d9ee6b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787785006.005700:0:22671:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787785006.005853:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09000/0x88ace7295d9ee64 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730ac expref: 22 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785006.005872:0:22671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08600/0x88ace7295d9ee6b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730ac expref: 21 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785006.005881:0:22671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:0.0:1787785006.005884:0:22671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787785006.005887:0:22671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951fda08600, rc 0) 00000100:00100000:0.0:1787785006.006258:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+21:18736:x1874627728148992:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 777us (990us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1787785006.006267:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 40 00000100:00100000:0.0:1787785006.009875:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785006.010028:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728149120 00000100:00100000:3.0:1787785006.010038:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728149120 00000100:00100000:3.0:1787785006.010106:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 41 00000100:00100000:3.0:1787785006.010115:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c34103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+21:18736:x1874627728149120:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:3.0:1787785006.010182:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9ee79 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785006.010198:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9ee79 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785006.010208:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9ee79 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785006.010243:0:22669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9ee79 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785006.010251:0:22669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9ee79 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785006.010267:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9ee79 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785006.010274:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787785006.010278:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9ee79 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785006.010300:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9ee79 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785006.010314:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:3.0:1787785006.010317:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787785006.010321:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9ee79 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785006.010327:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9ee79 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787785006.010422:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c34103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+21:18736:x1874627728149120:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 307us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785006.010430:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 41 00000100:00100000:2.0:1787785006.010810:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785006.011083:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728149248 00000100:00100000:3.0:1787785006.011091:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728149248 00000100:00100000:3.0:1787785006.011139:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:3.0:1787785006.011148:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e130c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+21:2406:x1874627728149248:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787785006.011163:0:22657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787785006.011180:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda08600/0x88ace7295d9ee6b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730ac expref: 21 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785006.011193:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:3.0:1787785006.011197:0:22657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787785006.011238:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e130c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+20:2406:x1874627728149248:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 90us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785006.011244:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:2.0:1787785006.016737:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785006.016931:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728149504 00000100:00100000:3.0:1787785006.016942:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728149504 00000100:00100000:3.0:1787785006.016997:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:3.0:1787785006.017007:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+20:18736:x1874627728149504:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:3.0:1787785006.017239:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+21:18736:x1874627728149504:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 232us (513us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1787785006.017259:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000040:00080000:0.0:1787785006.152214:0:23428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787785006.214450:0:22705:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787785006.518411:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785006.518994:0:25465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728149760 00000100:00100000:3.0:1787785006.519005:0:25465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728149760 00000100:00100000:3.0:1787785006.519126:0:25465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 42 00000100:00100000:3.0:1787785006.519136:0:25465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+21:18767:x1874627728149760:12345-192.168.202.41@tcp:101:cat.0 00010000:00010000:3.0:1787785006.519161:0:25465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787785006.519183:0:25465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9ee80 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e730b3 expref: -99 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785006.519326:0:25465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713a00/0x88ace7295d9ee87 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785006.519342:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713a00/0x88ace7295d9ee87 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785006.519354:0:25465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713a00/0x88ace7295d9ee87 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787785006.519375:0:25465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787785006.519521:0:25465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9ee80 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730b3 expref: 24 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785006.519540:0:25465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713a00/0x88ace7295d9ee87 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730b3 expref: 23 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785006.519555:0:25465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:3.0:1787785006.519558:0:25465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787785006.519561:0:25465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713a00, rc 0) 00000100:00100000:3.0:1787785006.519641:0:25465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+23:18767:x1874627728149760:12345-192.168.202.41@tcp:101:cat.0 Request processed in 507us (1241us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1787785006.519649:0:25465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 42 00000100:00100000:0.0:1787785006.527842:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787785006.527951:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785006.528169:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728150016 00000100:00100000:3.0:1787785006.528177:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728150016 00000100:00100000:3.0:1787785006.528228:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:3.0:1787785006.528308:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3413840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+23:18767:x1874627728150016:12345-192.168.202.41@tcp:35:cat.0 00000100:00100000:3.0:1787785006.528853:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3413840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+24:18767:x1874627728150016:12345-192.168.202.41@tcp:35:cat.0 Request processed in 616us (1020us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1787785006.528862:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:2.0:1787785006.528938:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728150144 00000100:00100000:2.0:1787785006.528943:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728150144 00000100:00100000:2.0:1787785006.528985:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:2.0:1787785006.528993:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3410f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+24:2405:x1874627728150144:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787785006.529004:0:22655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787785006.529030:0:22655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713a00/0x88ace7295d9ee87 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730b3 expref: 24 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785006.529047:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:2.0:1787785006.529053:0:22655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787785006.529074:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3410f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+23:2405:x1874627728150144:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 81us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785006.529082:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:2.0:1787785006.640099:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785006.640305:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728150400 00000100:00100000:3.0:1787785006.640317:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728150400 00000100:00100000:3.0:1787785006.640394:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:3.0:1787785006.640405:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+23:18773:x1874627728150400:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:3.0:1787785006.640430:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787785006.640452:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9ee95 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e730ba expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785006.640563:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713400/0x88ace7295d9ee9c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785006.640577:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713400/0x88ace7295d9ee9c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785006.640605:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713400/0x88ace7295d9ee9c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787785006.640618:0:22669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787785006.640806:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9ee95 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730ba expref: 26 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785006.640825:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713400/0x88ace7295d9ee9c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730ba expref: 25 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785006.640834:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:3.0:1787785006.640837:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787785006.640840:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713400, rc 0) 00000100:00100000:3.0:1787785006.640901:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+25:18773:x1874627728150400:12345-192.168.202.41@tcp:101:dd.0 Request processed in 498us (814us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1787785006.640909:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:2.0:1787785006.646432:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787785006.647282:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728150656 00000100:00100000:0.0:1787785006.647293:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728150656 00000100:00100000:0.0:1787785006.647363:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:0.0:1787785006.647475:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+25:2406:x1874627728150656:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787785006.647493:0:22656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787785006.647692:0:22656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713400/0x88ace7295d9ee9c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730ba expref: 25 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785006.647711:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:0.0:1787785006.647716:0:22656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787785006.647863:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+24:2406:x1874627728150656:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 391us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787785006.647871:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:0.0:1787785006.655833:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785006.655989:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728150528 00000100:00100000:2.0:1787785006.656011:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728150528 00000100:00100000:2.0:1787785006.656175:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 44 00000100:00100000:2.0:1787785006.656187:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+24:18773:x1874627728150528:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:2.0:1787785006.656212:0:22671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787785006.656234:0:22671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628a00/0x88ace7295d9eeaa lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e730c1 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785006.656280:0:22671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9eeb1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785006.656294:0:22671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9eeb1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785006.656306:0:22671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9eeb1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785006.656430:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628a00/0x88ace7295d9eeaa lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730c1 expref: 26 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785006.656450:0:22671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9eeb1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730c1 expref: 25 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785006.656459:0:22671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:2.0:1787785006.656463:0:22671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787785006.656466:0:22671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629000, rc 0) 00000100:00100000:2.0:1787785006.656907:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+25:18773:x1874627728150528:12345-192.168.202.41@tcp:101:dd.0 Request processed in 720us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785006.656915:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 44 00000100:00100000:1.0:1787785006.663973:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787785006.664054:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728150912 00000100:00100000:0.0:1787785006.664064:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728150912 00000100:00100000:0.0:1787785006.664127:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 45 00000100:00100000:0.0:1787785006.664137:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3270f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+25:18773:x1874627728150912:12345-192.168.202.41@tcp:36:dd.0 00010000:00010000:0.0:1787785006.664190:0:22670:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787785006.664217:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713c00/0x88ace7295d9ee4f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7309e expref: 25 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785006.664236:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:0.0:1787785006.664241:0:22670:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787785006.664431:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09000/0x88ace7295d9eeb8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785006.664466:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09000/0x88ace7295d9eeb8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785006.664475:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09000/0x88ace7295d9eeb8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787785006.664530:0:22670:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1787785006.664554:0:22670:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023babfdc reply state 0000000087bd188e transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09000/0x88ace7295d9eeb8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785006.664576:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09000/0x88ace7295d9eeb8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785006.664583:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:0.0:1787785006.664586:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787785006.664589:0:22670:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787785006.665080:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3270f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+27:18773:x1874627728150912:12345-192.168.202.41@tcp:36:dd.0 Request processed in 942us (1115us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1787785006.665089:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 45 00000020:00080000:0.0:1787785006.665095:0:22670:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787785006.790109:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787785006.832824:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785006.832905:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728151168 00000100:00100000:3.0:1787785006.832915:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728151168 00000100:00100000:3.0:1787785006.832975:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:3.0:1787785006.832985:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c34121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+27:18773:x1874627728151168:12345-192.168.202.41@tcp:35:dd.0 00000100:00100000:3.0:1787785006.833235:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c34121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+28:18773:x1874627728151168:12345-192.168.202.41@tcp:35:dd.0 Request processed in 251us (419us total) trans 12884901907 rc 0/0 00000100:00100000:3.0:1787785006.833243:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:2.0:1787785007.105340:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785007.105813:0:25465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728151296 00000100:00100000:3.0:1787785007.105825:0:25465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728151296 00000100:00100000:3.0:1787785007.106891:0:25465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:3.0:1787785007.106905:0:25465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+28:18787:x1874627728151296:12345-192.168.202.41@tcp:101:stat.0 00010000:00010000:3.0:1787785007.106943:0:25465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787785007.106964:0:25465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9eebf lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e730c8 expref: -99 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107033:0:25465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9eec6 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107048:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9eec6 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107061:0:25465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9eec6 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107074:0:25465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9eecd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107081:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9eecd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107089:0:25465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9eecd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107158:0:25465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9eed4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107167:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9eed4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107174:0:25465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9eed4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787785007.107215:0:25465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787785007.107226:0:25465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787785007.107266:0:25465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9eed4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107278:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9eed4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107285:0:25465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9eec6 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107291:0:25465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9eec6 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107297:0:25465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9eec6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107303:0:25465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787785007.107307:0:25465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9eec6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107314:0:25465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9eec6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107324:0:25465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8951f512b400) 00010000:00010000:3.0:1787785007.107327:0:25465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787785007.107331:0:25465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9eec6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107337:0:25465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9eec6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107349:0:25465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9eecd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107376:0:25465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9eecd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107382:0:25465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9eecd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107387:0:25465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787785007.107390:0:25465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9eecd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107396:0:25465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9eecd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107405:0:25465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8951c133c800) 00010000:00010000:3.0:1787785007.107408:0:25465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787785007.107411:0:25465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9eecd lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107416:0:25465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9eecd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107891:0:25465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9eebf lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730c8 expref: 30 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107908:0:25465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9eed4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730c8 expref: 29 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.107915:0:25465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:3.0:1787785007.107918:0:25465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787785007.107927:0:25465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713200, rc 0) 00000100:00100000:3.0:1787785007.107993:0:25465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+29:18787:x1874627728151296:12345-192.168.202.41@tcp:101:stat.0 Request processed in 1091us (2665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785007.108001:0:25465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00080000:0.0:1787785007.108431:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787785007.229484:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785007.229726:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728151552 00000100:00100000:3.0:1787785007.229738:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728151552 00000100:00100000:3.0:1787785007.229834:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:3.0:1787785007.229846:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+29:18793:x1874627728151552:12345-192.168.202.41@tcp:36:truncate.0 00010000:00010000:3.0:1787785007.229908:0:22669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787785007.229942:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9eed4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730c8 expref: 29 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.229964:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:3.0:1787785007.229970:0:22669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787785007.230162:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9eedb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.230176:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9eedb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.230187:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9eedb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787785007.230232:0:22669:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:3.0:1787785007.230256:0:22669:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ead3b0d reply state 00000000ff87aebd transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9eedb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.230269:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9eedb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.230297:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:3.0:1787785007.230299:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787785007.230303:0:22669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787785007.230428:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+31:18793:x1874627728151552:12345-192.168.202.41@tcp:36:truncate.0 Request processed in 584us (953us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1787785007.230436:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 47 00000020:00080000:3.0:1787785007.230442:0:22669:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787785007.588817:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785007.590125:0:25465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728151680 00000100:00100000:3.0:1787785007.590138:0:25465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728151680 00000100:00100000:3.0:1787785007.590229:0:25465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 48 00000100:00100000:3.0:1787785007.590240:0:25465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c32721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+31:18807:x1874627728151680:12345-192.168.202.41@tcp:101:stat.0 00010000:00010000:3.0:1787785007.590638:0:25465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787785007.590731:0:25465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9eee2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e730cf expref: -99 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.590824:0:25465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9eee9 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.590839:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9eee9 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.590850:0:25465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9eee9 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.590861:0:25465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9eef0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.590868:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9eef0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.590897:0:25465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9eef0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.590974:0:25465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9eef7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.590983:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9eef7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.590989:0:25465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9eef7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787785007.591030:0:25465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1787785007.591035:0:25465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787785007.591056:0:25465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9eef7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.591068:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9eef7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.591076:0:25465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9eee9 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.591082:0:25465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9eee9 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.591089:0:25465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9eee9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.591094:0:25465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787785007.591098:0:25465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9eee9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.591114:0:25465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9eee9 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.591128:0:25465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8951f512b400) 00010000:00010000:3.0:1787785007.591130:0:25465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787785007.591136:0:25465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9eee9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.591141:0:25465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9eee9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.591154:0:25465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9eef0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.591160:0:25465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9eef0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.591165:0:25465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9eef0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.591170:0:25465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787785007.591172:0:25465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9eef0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.591178:0:25465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9eef0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.591184:0:25465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8951c133c800) 00010000:00010000:3.0:1787785007.591187:0:25465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787785007.591189:0:25465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9eef0 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.591205:0:25465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9eef0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.591233:0:25465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9eee2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730cf expref: 33 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.591245:0:25465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9eef7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730cf expref: 32 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.591252:0:25465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:3.0:1787785007.591254:0:25465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787785007.591257:0:25465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712c00, rc 0) 00000100:00100000:3.0:1787785007.591863:0:25465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c32721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+32:18807:x1874627728151680:12345-192.168.202.41@tcp:101:stat.0 Request processed in 1623us (3053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785007.591872:0:25465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 48 00000100:00100000:3.0:1787785007.750161:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787785007.750188:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb256d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750281216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787785007.750261:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787785007.750366:0:24184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750281216 00000100:00100000:1.0:1787785007.750374:0:24184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750281216 00000100:00100000:1.0:1787785007.750429:0:24184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787785007.750447:0:24184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3385680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750281216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787785007.750476:0:24184:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787785007.750523:0:24184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3385680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750281216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785007.750531:0:24184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787785007.750829:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb256d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750281216:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787785007.750852:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787785007.750997:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750281344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787785007.751030:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787785007.751104:0:24184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750281344 00000100:00100000:2.0:1787785007.751109:0:24184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750281344 00000100:00100000:2.0:1787785007.751144:0:24184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787785007.751152:0:24184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c33843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750281344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787785007.751163:0:24184:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787785007.751201:0:24184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c33843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1874627750281344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785007.751208:0:24184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787785007.751237:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1874627750281344:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787785007.751292:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787785007.802613:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785007.802802:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728151936 00000100:00100000:3.0:1787785007.802812:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728151936 00000100:00100000:3.0:1787785007.802873:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 49 00000100:00100000:3.0:1787785007.802898:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+32:18817:x1874627728151936:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1787785007.802918:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787785007.802940:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9eefe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e730d6 expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787785007.803059:0:22669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787785007.803180:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9eefe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730d6 expref: 34 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.803196:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8950c23c7400) 00010000:00010000:3.0:1787785007.803200:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787785007.803204:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9eefe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730d6 expref: 34 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.803218:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713200, rc 0) 00000100:00100000:3.0:1787785007.803300:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+33:18817:x1874627728151936:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 403us (698us total) trans 12884901910 rc 301/301 00000100:00100000:3.0:1787785007.803308:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 49 00000100:00100000:2.0:1787785007.813176:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785007.813263:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728152192 00000100:00100000:3.0:1787785007.813273:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728152192 00000100:00100000:3.0:1787785007.813338:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:3.0:1787785007.813348:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c34ae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+33:18817:x1874627728152192:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:3.0:1787785007.813587:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c34ae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+34:18817:x1874627728152192:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 240us (418us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1787785007.813596:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 10 00010000:00010000:1.0:1787785007.813954:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787785007.905589:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785007.905811:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728152448 00000100:00100000:2.0:1787785007.905820:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728152448 00000100:00100000:2.0:1787785007.905888:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 50 00000100:00100000:2.0:1787785007.905898:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb255e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+34:18823:x1874627728152448:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1787785007.905923:0:22671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787785007.905945:0:22671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629e00/0x88ace7295d9ef0c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e730dd expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785007.906059:0:22671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef13 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785007.906074:0:22671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9ee3a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73097 expref: 35 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785007.906084:0:22671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9eef7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730cf expref: 35 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785007.906107:0:22671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef13 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785007.906140:0:22671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9eef7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730cf expref: 35 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785007.906155:0:22671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9eef7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730cf expref: 35 pid: 25465 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787785007.906170:0:22671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22671:1874627750281472:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787785007.906421:0:22671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9ee3a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73097 expref: 35 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785007.906432:0:22671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9ee3a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73097 expref: 35 pid: 22670 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787785007.906442:0:22671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b1680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22671:1874627750281600:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787785007.906466:0:22671:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df66f000 going to sleep for 11 seconds 00000100:00100000:2.0:1787785007.914801:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785007.914849:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787785007.915023:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728152576 00000100:00100000:1.0:1787785007.915033:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728152576 00010000:00010000:1.0:1787785007.915076:0:22656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9eef7 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730cf expref: 36 pid: 25465 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787785007.915113:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728152704 00000100:00100000:1.0:1787785007.915129:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728152704 00010000:00010000:1.0:1787785007.915146:0:22656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9ee3a lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73097 expref: 37 pid: 22670 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787785007.915165:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:1.0:1787785007.915175:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d2477850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+37:2405:x1874627728152576:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787785007.915191:0:22656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787785007.915199:0:22656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9eef7 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730cf expref: 37 pid: 25465 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785007.915212:0:22656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9eef7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730cf expref: 37 pid: 25465 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785007.915247:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:1.0:1787785007.915252:0:22656:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef13 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785007.915644:0:22656:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef13 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785007.915663:0:22656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787785007.915719:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d2477850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+37:2405:x1874627728152576:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 545us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785007.915728:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:1.0:1787785007.915805:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:1.0:1787785007.915812:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+36:2405:x1874627728152704:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787785007.915821:0:22656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787785007.915827:0:22656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9ee3a lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73097 expref: 36 pid: 22670 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785007.915844:0:22656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9ee3a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73097 expref: 36 pid: 22670 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785007.915857:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:1.0:1787785007.915861:0:22656:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef13 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785007.915870:0:22656:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef13 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785007.915879:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef13 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785007.915895:0:22656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787785007.915914:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+36:2405:x1874627728152704:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 103us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785007.915920:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 18 00010000:00010000:0.0:1787785007.916482:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712c00/0x88ace7295d9eef7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730cf expref: 35 pid: 25465 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787785007.916501:0:22671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22671:1874627750281472:192.168.202.41@tcp:104: 00010000:00010000:0.0:1787785007.916515:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df603400/0x88ace7295d9ee3a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73097 expref: 34 pid: 22670 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787785007.916539:0:22671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b1680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22671:1874627750281600:192.168.202.41@tcp:104: 00010000:00010000:0.0:1787785007.916559:0:22671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef13 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785007.916568:0:22671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef13 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785007.916574:0:22671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef13 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787785007.916593:0:22671:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1787785007.917510:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629e00/0x88ace7295d9ef0c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730dd expref: 35 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785007.917532:0:22671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef13 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730dd expref: 34 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785007.917541:0:22671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:0.0:1787785007.917544:0:22671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787785007.917547:0:22671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628400, rc 0) 00000100:00100000:0.0:1787785007.917613:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb255e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+34:18823:x1874627728152448:12345-192.168.202.41@tcp:101:bash.0 Request processed in 11715us (12033us total) trans 12884901912 rc 0/0 00000100:00100000:0.0:1787785007.917623:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 50 00000100:00100000:0.0:1787785007.924754:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785007.926148:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728152960 00000100:00100000:3.0:1787785007.926178:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728152960 00000100:00100000:2.0:1787785007.926828:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 51 00000100:00100000:2.0:1787785007.926844:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3410f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+34:18823:x1874627728152960:12345-192.168.202.41@tcp:36:bash.0 00010000:00010000:2.0:1787785007.927207:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9ef21 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785007.927754:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9ef21 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785007.927843:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9ef21 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787785007.927912:0:22670:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:2.0:1787785007.927941:0:22670:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099724aee reply state 0000000086cfa346 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9ef21 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785007.927955:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9ef21 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785007.927963:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:2.0:1787785007.927966:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787785007.927971:0:22670:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787785007.929257:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3410f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+37:18823:x1874627728152960:12345-192.168.202.41@tcp:36:bash.0 Request processed in 2408us (4503us total) trans 12884901914 rc 0/0 00000100:00100000:2.0:1787785007.929270:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 51 00000020:00080000:2.0:1787785007.929276:0:22670:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787785007.935364:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785007.935493:0:25465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728153088 00000100:00100000:3.0:1787785007.935502:0:25465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728153088 00000100:00100000:3.0:1787785007.935565:0:25465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:3.0:1787785007.935576:0:25465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb2561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+37:18823:x1874627728153088:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:3.0:1787785007.935602:0:25465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787785007.935622:0:25465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9ef28 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e730e4 expref: -99 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.935698:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9ef28 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730e4 expref: 38 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.935714:0:25465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9ef28 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730e4 expref: 38 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.935733:0:25465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:3.0:1787785007.935736:0:25465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787785007.935739:0:25465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713200, rc 0) 00000100:00100000:3.0:1787785007.935831:0:25465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb2561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+38:18823:x1874627728153088:12345-192.168.202.41@tcp:101:bash.0 Request processed in 257us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785007.935849:0:25465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:1.0:1787785007.943209:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785007.943301:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728153216 00000100:00100000:3.0:1787785007.943311:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728153216 00000100:00100000:3.0:1787785007.943382:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:3.0:1787785007.943392:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb256940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+38:18823:x1874627728153216:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:3.0:1787785007.943413:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787785007.943435:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9ef2f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e730eb expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.943557:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9ef36 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.943572:0:22669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef13 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730dd expref: 39 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.943581:0:22669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9ef36 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.943617:0:22669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef13 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730dd expref: 39 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.943630:0:22669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef13 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730dd expref: 39 pid: 22671 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787785007.943644:0:22669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c33870c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22669:1874627750281728:192.168.202.41@tcp:104: 00000100:00100000:3.0:1787785007.943738:0:22669:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e32540 going to sleep for 11 seconds 00000100:00100000:1.0:1787785007.947484:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787785007.947584:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728153344 00000100:00100000:0.0:1787785007.947594:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728153344 00010000:00010000:0.0:1787785007.947636:0:22656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef13 lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730dd expref: 40 pid: 22671 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787785007.947704:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:0.0:1787785007.947714:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb2543c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+40:2405:x1874627728153344:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787785007.947729:0:22656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787785007.947737:0:22656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef13 lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730dd expref: 40 pid: 22671 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785007.947750:0:22656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef13 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730dd expref: 40 pid: 22671 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785007.947809:0:22656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:0.0:1787785007.947815:0:22656:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9ef36 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785007.947825:0:22656:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9ef36 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785007.947832:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9ef36 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785007.947850:0:22656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787785007.947896:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb2543c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+40:2405:x1874627728153344:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 184us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787785007.947904:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 19 00010000:00010000:3.0:1787785007.949188:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef13 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730dd expref: 39 pid: 22671 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787785007.949210:0:22669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c33870c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22669:1874627750281728:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787785007.949243:0:22669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9ef36 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.949253:0:22669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9ef36 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.949280:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9ef36 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787785007.949329:0:22669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787785007.949333:0:22669:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787785007.949349:0:22669:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9ef36 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.949395:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9ef2f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730eb expref: 39 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.949408:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9ef36 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730eb expref: 38 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.949417:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:3.0:1787785007.949419:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787785007.949422:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713e00, rc 0) 00000100:00100000:3.0:1787785007.949475:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb256940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+38:18823:x1874627728153216:12345-192.168.202.41@tcp:101:bash.0 Request processed in 6085us (6277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785007.949482:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:1.0:1787785007.953065:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785007.953159:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728153600 00000100:00100000:3.0:1787785007.953170:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728153600 00000100:00100000:3.0:1787785007.953348:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:3.0:1787785007.953370:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb256580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+38:18823:x1874627728153600:12345-192.168.202.41@tcp:103:bash.0 00010000:00010000:3.0:1787785007.953388:0:22657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787785007.953416:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9ef28 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730e4 expref: 38 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.953458:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9ef36 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730eb expref: 37 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.953468:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:3.0:1787785007.953472:0:22657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787785007.953533:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb256580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+36:18823:x1874627728153600:12345-192.168.202.41@tcp:103:bash.0 Request processed in 167us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785007.953540:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:1.0:1787785007.956505:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785007.956824:0:25465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728153728 00000100:00100000:3.0:1787785007.956833:0:25465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728153728 00000100:00100000:3.0:1787785007.956890:0:25465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:3.0:1787785007.956900:0:25465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fb256d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+36:18823:x1874627728153728:12345-192.168.202.41@tcp:58:bash.0 00010000:00010000:3.0:1787785007.956997:0:25465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9ef3d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.957082:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9ef3d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785007.957096:0:25465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9ef3d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787785007.957910:0:25465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787785007.957937:0:25465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1787785007.958063:0:25465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1787785007.958148:0:25465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fb256d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+36:18823:x1874627728153728:12345-192.168.202.41@tcp:58:bash.0 Request processed in 1246us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785007.958157:0:25465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:1.0:1787785007.961406:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785007.961488:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728153856 00000100:00100000:2.0:1787785007.961497:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728153856 00000100:00100000:2.0:1787785007.961561:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:2.0:1787785007.961572:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c12af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+36:18823:x1874627728153856:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1787785007.961592:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787785007.961613:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628a00/0x88ace7295d9ef44 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e730f2 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785007.961868:0:22670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9ef3d lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785007.961894:0:22670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628a00/0x88ace7295d9ef44 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730f2 expref: 37 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785007.961913:0:22670:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9ef3d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785007.961926:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628a00/0x88ace7295d9ef44 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730f2 expref: 37 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785007.961939:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:2.0:1787785007.961943:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787785007.961947:0:22670:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628a00/0x88ace7295d9ef44 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730f2 expref: 37 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785007.961955:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628a00, rc 0) 00000100:00100000:2.0:1787785007.962116:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c12af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+37:18823:x1874627728153856:12345-192.168.202.41@tcp:101:bash.0 Request processed in 545us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785007.962124:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:0.0:1787785008.262420:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951efef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750281856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787785008.262511:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787785008.262687:0:22675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750281856 00000100:00100000:1.0:1787785008.262697:0:22675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750281856 00000100:00100000:1.0:1787785008.262762:0:22675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787785008.262796:0:22675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3410780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750281856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787785008.262830:0:22675:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1787785008.262896:0:22675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3410780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750281856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785008.262903:0:22675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787785008.262948:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951efef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750281856:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787785008.263210:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787785008.263221:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750281984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787785008.263263:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787785008.263290:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750281984 00000100:00100000:2.0:1787785008.263293:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750281984 00000100:00100000:2.0:1787785008.263316:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787785008.263322:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750281984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787785008.263339:0:23412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787785008.263387:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750281984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785008.263393:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787785008.263418:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750281984:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1787785008.264644:0:22705:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1787785008.264651:0:22705:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787785008.264677:0:22705:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1787785008.264686:0:22705:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1787785008.264823:0:22705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951efef0000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22705:1874627750282112:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787785008.264904:0:22705:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d1db7300 going to sleep for 11 seconds 00000100:00100000:1.0:1787785008.279274:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787785008.279440:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728153984 00000100:00100000:0.0:1787785008.279461:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728153984 00000100:00100000:0.0:1787785008.279526:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:0.0:1787785008.279536:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+38:18824:x1874627728153984:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787785008.279572:0:22671:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787785008.279718:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+38:18824:x1874627728153984:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 182us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787785008.279725:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:2.0:1787785008.281403:0:22705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951efef0000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22705:1874627750282112:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787785008.292312:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785008.292406:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728154112 00000100:00100000:3.0:1787785008.292416:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728154112 00000100:00100000:3.0:1787785008.292477:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:3.0:1787785008.292494:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3413840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+37:18824:x1874627728154112:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787785008.292591:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9ef4b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292608:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9ef4b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292619:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9ef4b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292634:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9ef52 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292640:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9ef52 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292645:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9ef52 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292667:0:22669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ef59 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292675:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ef59 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292682:0:22669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ef59 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787785008.292734:0:22669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787785008.292746:0:22669:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787785008.292761:0:22669:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ef59 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292802:0:22669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9ef4b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292808:0:22669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9ef4b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292815:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9ef4b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292821:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787785008.292825:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9ef4b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292833:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9ef4b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292846:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8950c23c7100) 00010000:00010000:3.0:1787785008.292848:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787785008.292853:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9ef4b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292859:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713e00/0x88ace7295d9ef4b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292872:0:22669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9ef52 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292878:0:22669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9ef52 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292894:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9ef52 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292899:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787785008.292901:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9ef52 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292907:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9ef52 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292914:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8951f512bf00) 00010000:00010000:3.0:1787785008.292916:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787785008.292919:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9ef52 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292925:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9ef52 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292939:0:22669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ef59 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292944:0:22669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ef59 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292948:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ef59 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292952:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1787785008.292954:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ef59 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292969:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ef59 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292977:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:3.0:1787785008.292979:0:22669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787785008.292982:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ef59 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.292987:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ef59 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787785008.293064:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3413840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+37:18824:x1874627728154112:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 Request processed in 578us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785008.293072:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:1.0:1787785008.298512:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787785008.298594:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728154368 00000100:00100000:0.0:1787785008.298604:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728154368 00000100:00100000:0.0:1787785008.298659:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:0.0:1787785008.298669:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+37:18824:x1874627728154368:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787785008.298692:0:22671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787785008.298715:0:22671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09200/0x88ace7295d9ef60 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e730f9 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785008.298867:0:22671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09400/0x88ace7295d9ef67 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785008.298885:0:22671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09400/0x88ace7295d9ef67 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785008.298898:0:22671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09400/0x88ace7295d9ef67 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787785008.298910:0:22671:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787785008.298990:0:22671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09400/0x88ace7295d9ef67 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785008.299029:0:22671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09400/0x88ace7295d9ef67 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785008.299037:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09400/0x88ace7295d9ef67 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785008.299043:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951fda09400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1787785008.299047:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09400/0x88ace7295d9ef67 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785008.299055:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09400/0x88ace7295d9ef67 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785008.299067:0:22671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:0.0:1787785008.299070:0:22671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787785008.299075:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09400/0x88ace7295d9ef67 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785008.299081:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09400/0x88ace7295d9ef67 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785008.299125:0:22671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09200/0x88ace7295d9ef60 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730f9 expref: 39 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785008.299136:0:22671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8950c23c7100) 00010000:00010000:0.0:1787785008.299138:0:22671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787785008.299142:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09200/0x88ace7295d9ef60 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730f9 expref: 39 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785008.299151:0:22671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951fda09200, rc 0) 00000100:00100000:0.0:1787785008.299213:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+38:18824:x1874627728154368:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 544us (709us total) trans 12884901915 rc 301/301 00000100:00100000:0.0:1787785008.299220:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:1.0:1787785008.309130:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785008.309274:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728154496 00000100:00100000:3.0:1787785008.309285:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728154496 00000100:00100000:3.0:1787785008.309348:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:3.0:1787785008.309368:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+38:18824:x1874627728154496:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787785008.309405:0:22669:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787785008.309745:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+38:18824:x1874627728154496:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 378us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785008.309752:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:1.0:1787785008.313256:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787785008.316596:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728154752 00000100:00100000:0.0:1787785008.316618:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728154752 00000100:00100000:0.0:1787785008.316815:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 60 00000100:00100000:0.0:1787785008.316827:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+38:18824:x1874627728154752:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787785008.316851:0:22671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787785008.316877:0:22671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09200/0x88ace7295d9ef75 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e73100 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787785008.317340:0:22671:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =59 00000004:00080000:0.0:1787785008.317347:0:22671:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+59 in llog 00000004:00080000:0.0:1787785008.317381:0:22671:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:0.0:1787785008.317558:0:22671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09400/0x88ace7295d9ef7c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785008.317574:0:22671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09400/0x88ace7295d9ef7c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785008.317585:0:22671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09400/0x88ace7295d9ef7c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785008.317643:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09200/0x88ace7295d9ef75 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73100 expref: 41 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785008.317663:0:22671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09400/0x88ace7295d9ef7c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73100 expref: 40 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785008.317693:0:22671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8950c23c7600) 00010000:00010000:0.0:1787785008.317696:0:22671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787785008.317700:0:22671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951fda09400, rc 0) 00000100:00100000:0.0:1787785008.317833:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+40:18824:x1874627728154752:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 1008us (4588us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1787785008.317841:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 60 00000100:00100000:1.0:1787785008.333681:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785008.337417:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728155008 00000100:00100000:2.0:1787785008.337440:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728155008 00000100:00100000:2.0:1787785008.337528:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:2.0:1787785008.337540:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951efef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+40:18824:x1874627728155008:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787785008.337612:0:22670:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787785008.337643:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09400/0x88ace7295d9ef7c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73100 expref: 40 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.337666:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8950c23c7600) 00010000:00010000:2.0:1787785008.337680:0:22670:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787785008.337710:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9ef8a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.337723:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9ef8a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.337733:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9ef8a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.337749:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef91 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x9f909193 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.337757:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef91 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x9f909193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.337838:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef91 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x9f909193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.337890:0:22670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9ef8a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.337897:0:22670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9ef8a lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.337904:0:22670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9ef8a lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.337910:0:22670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787785008.337914:0:22670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9ef8a lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.337922:0:22670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9ef8a lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.337932:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8951f512b400) 00010000:00010000:2.0:1787785008.337935:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787785008.337938:0:22670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9ef8a lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.337945:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9ef8a lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.337955:0:22670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef91 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x9f909193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.337961:0:22670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef91 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x9f909193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.337974:0:22670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef91 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x9f909193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.337980:0:22670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787785008.337983:0:22670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef91 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x9f909193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.337989:0:22670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef91 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x9f909193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.337997:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x9f909193 (ffff8951faa51800) 00010000:00010000:2.0:1787785008.338000:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787785008.338003:0:22670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef91 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x9f909193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.338091:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9ef91 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x9f909193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787785008.338200:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951efef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+39:18824:x1874627728155008:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 661us (4531us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787785008.338208:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:1.0:1787785008.342826:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785008.342913:0:25465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728155136 00000100:00100000:3.0:1787785008.342923:0:25465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728155136 00000100:00100000:3.0:1787785008.342968:0:25465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 62 00000100:00100000:3.0:1787785008.342976:0:25465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+39:18824:x1874627728155136:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787785008.342995:0:25465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787785008.343041:0:25465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ef98 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e73107 expref: -99 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.343075:0:25465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9ef9f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.343089:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9ef9f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.343100:0:25465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9ef9f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.343199:0:25465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9ef98 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73107 expref: 41 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.343215:0:25465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713200/0x88ace7295d9ef9f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73107 expref: 40 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.343224:0:25465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8951f512bf00) 00010000:00010000:3.0:1787785008.343227:0:25465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787785008.343230:0:25465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713200, rc 0) 00000100:00100000:3.0:1787785008.343283:0:25465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+40:18824:x1874627728155136:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 307us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785008.343290:0:25465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 62 00000100:00100000:0.0:1787785008.348831:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785008.348932:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728155392 00000100:00100000:2.0:1787785008.348941:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728155392 00000100:00100000:2.0:1787785008.349004:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:2.0:1787785008.349021:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c34121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+40:18824:x1874627728155392:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787785008.349109:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9efa6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.349126:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9efa6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.349151:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9efa6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787785008.349325:0:22670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:2.0:1787785008.349335:0:22670:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748598566766ns, next at 749598564439ns, rc = 0 00000004:00010000:2.0:1787785008.349399:0:22670:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0711a6a reply state 00000000307bfc70 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9efa6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.349414:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9efa6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.349423:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8951f512bf00) 00010000:00010000:2.0:1787785008.349426:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787785008.351124:0:22670:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787785008.351289:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c34121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+42:18824:x1874627728155392:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 2271us (2464us total) trans 12884901917 rc 0/0 00000100:00100000:2.0:1787785008.351299:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:1.0:1787785008.359265:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785008.359416:0:25465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728155520 00000100:00100000:3.0:1787785008.359427:0:25465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728155520 00000100:00100000:3.0:1787785008.359510:0:25465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 64 00000100:00100000:3.0:1787785008.359520:0:25465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+42:18824:x1874627728155520:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787785008.359550:0:25465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787785008.359584:0:25465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9efad lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e7310e expref: -99 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.359650:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9efad lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7310e expref: 43 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.359665:0:25465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9efad lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7310e expref: 43 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.359684:0:25465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8951f512bf00) 00010000:00010000:3.0:1787785008.359687:0:25465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787785008.359691:0:25465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3712400, rc 0) 00000100:00100000:3.0:1787785008.359756:0:25465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+43:18824:x1874627728155520:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 237us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785008.359763:0:25465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 64 00000100:00100000:3.0:1787785008.364535:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785008.364702:0:24684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728155648 00000100:00100000:2.0:1787785008.364712:0:24684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728155648 00000100:00100000:2.0:1787785008.364840:0:24684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:2.0:1787785008.364852:0:24684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c33870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+5:2405:x1874627728155648:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787785008.365128:0:24684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c33870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:2405:x1874627728155648:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 278us (605us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1787785008.365137:0:24684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00080000:3.0:1787785008.365925:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787785008.373912:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785008.377966:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728155904 00000100:00100000:3.0:1787785008.377982:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728155904 00000100:00100000:2.0:1787785008.378284:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:2.0:1787785008.378296:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c5629e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+43:18824:x1874627728155904:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787785008.378803:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c5629e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+44:18824:x1874627728155904:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 507us (4903us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1787785008.378814:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:1.0:1787785008.382070:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785008.382164:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728156160 00000100:00100000:3.0:1787785008.382174:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728156160 00000100:00100000:3.0:1787785008.382261:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:3.0:1787785008.382271:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+44:18824:x1874627728156160:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787785008.382395:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+44:18824:x1874627728156160:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 125us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785008.382404:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:3.0:1787785008.385850:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787785008.386059:0:25465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728156288 00000100:00100000:1.0:1787785008.386070:0:25465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728156288 00000100:00100000:1.0:1787785008.386143:0:25465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 66 00000100:00100000:1.0:1787785008.386154:0:25465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3386580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+44:18824:x1874627728156288:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787785008.386177:0:25465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787785008.386202:0:25465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9efb4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e73115 expref: -99 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.386314:0:25465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031800/0x88ace7295d9efbb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.386332:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031800/0x88ace7295d9efbb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.386345:0:25465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031800/0x88ace7295d9efbb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787785008.386754:0:25465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787785008.386814:0:25465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031800/0x88ace7295d9efbb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.386845:0:25465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030400/0x88ace7295d9efb4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73115 expref: 46 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.386867:0:25465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031800/0x88ace7295d9efbb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73115 expref: 45 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.386876:0:25465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8951f512bf00) 00010000:00010000:1.0:1787785008.386879:0:25465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787785008.386883:0:25465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951c0031800, rc 0) 00000100:00100000:1.0:1787785008.386953:0:25465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3386580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+45:18824:x1874627728156288:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 800us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785008.386961:0:25465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 66 00000100:00100000:1.0:1787785008.392396:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785008.392540:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728156416 00000100:00100000:3.0:1787785008.392574:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728156416 00000100:00100000:3.0:1787785008.392629:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:3.0:1787785008.392640:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c5628f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:2405:x1874627728156416:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787785008.392661:0:24179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787785008.392684:0:24179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023e8a2e3/0x88ace7295d9efc2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e7311c expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787785008.392715:0:24179:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f6f30, blocks: 0x0 00010000:00010000:3.0:1787785008.392738:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=748s v=(0 0) 00010000:00010000:3.0:1787785008.392744:0:24179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787785008.392755:0:24179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023e8a2e3/0x88ace7295d9efc2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7311c expref: 7 pid: 24179 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.392801:0:24179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000023e8a2e3/0x88ace7295d9efc2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7311c expref: 7 pid: 24179 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.392816:0:24179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8950c3713e00, rc 0) 00000100:00100000:3.0:1787785008.392890:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c5628f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+7:2405:x1874627728156416:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 252us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785008.392898:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:1.0:1787785008.396967:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785008.397120:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728156672 00000100:00100000:3.0:1787785008.397134:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728156672 00000100:00100000:3.0:1787785008.397211:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00100000:3.0:1787785008.397223:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+45:18824:x1874627728156672:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787785008.397386:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+45:18824:x1874627728156672:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 165us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785008.397414:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00100000:0.0:1787785008.402681:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785008.402956:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728156800 00000100:00100000:3.0:1787785008.402966:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728156800 00000100:00100000:3.0:1787785008.403042:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00100000:3.0:1787785008.403054:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+45:18824:x1874627728156800:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787785008.406392:0:22650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:2.0:1787785008.406411:0:22650:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787785008.406505:0:22650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:2.0:1787785008.406694:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030200/0x88ace7295d9edd8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.406708:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030200/0x88ace7295d9edd8 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.406716:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030200/0x88ace7295d9edd8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.406724:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c0030200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787785008.406729:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030200/0x88ace7295d9edd8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.406736:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030200/0x88ace7295d9edd8 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.406755:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8951f512b400) 00010000:00010000:2.0:1787785008.406758:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787785008.406763:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030200/0x88ace7295d9edd8 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.406798:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0030200/0x88ace7295d9edd8 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787785008.407261:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787785008.407293:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5628b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750282240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787785008.407378:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787785008.408918:0:24684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750282240 00000100:00100000:2.0:1787785008.408942:0:24684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750282240 00000100:00100000:2.0:1787785008.409019:0:24684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787785008.409029:0:24684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c5628780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750282240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787785008.409164:0:24684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787785008.409168:0:24684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1787785008.409170:0:24684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787785008.409173:0:24684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787785008 -> 1787785008 00002000:00010000:2.0:1787785008.409175:0:24684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787785008.409241:0:24684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c5628780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1874627750282240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 213us (1863us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1787785008.409251:0:24684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:2.0:1787785008.409300:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8951c5628b40/2, rc 0, transno 12884901892 00000100:00100000:2.0:1787785008.409307:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5628b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750282240:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787785008.410615:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+20:18824:x1874627728156800:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 Request processed in 7557us (7940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785008.410627:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 68 00010000:00010000:1.0:1787785008.412363:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9ed84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412381:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9ed84 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412388:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9ed84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412394:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951c151f200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787785008.412408:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9ed84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412417:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9ed84 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412547:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8951f512bb00) 00010000:00010000:1.0:1787785008.412551:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787785008.412619:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9ed84 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412627:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c151f200/0x88ace7295d9ed84 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412654:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713000/0x88ace7295d9ed8b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412660:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713000/0x88ace7295d9ed8b lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412688:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713000/0x88ace7295d9ed8b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412692:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787785008.412696:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713000/0x88ace7295d9ed8b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412702:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713000/0x88ace7295d9ed8b lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412711:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8951f512b400) 00010000:00010000:1.0:1787785008.412714:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787785008.412717:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713000/0x88ace7295d9ed8b lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412723:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713000/0x88ace7295d9ed8b lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412739:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9ee33 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412746:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9ee33 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412752:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9ee33 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412757:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951df602000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787785008.412760:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9ee33 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412805:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9ee33 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412813:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8951c133c800) 00010000:00010000:1.0:1787785008.412816:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787785008.412818:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9ee33 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412824:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951df602000/0x88ace7295d9ee33 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412840:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09000/0x88ace7295d9eeb8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412847:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09000/0x88ace7295d9eeb8 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412852:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09000/0x88ace7295d9eeb8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412857:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951fda09000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787785008.412860:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09000/0x88ace7295d9eeb8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412866:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09000/0x88ace7295d9eeb8 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412874:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:1.0:1787785008.412876:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787785008.412880:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09000/0x88ace7295d9eeb8 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412897:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951fda09000/0x88ace7295d9eeb8 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412910:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9eedb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412916:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9eedb lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412923:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9eedb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412928:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787785008.412931:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9eedb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412937:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9eedb lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412945:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:1.0:1787785008.412947:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787785008.412950:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9eedb lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412956:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712200/0x88ace7295d9eedb lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412966:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9ef21 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412972:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9ef21 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412984:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9ef21 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.412990:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787785008.412993:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9ef21 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.413000:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9ef21 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.413530:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:1.0:1787785008.413534:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787785008.413539:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9ef21 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.413547:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9ef21 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.413695:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9efa6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.413703:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9efa6 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.413709:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9efa6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.413714:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1628400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787785008.413717:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9efa6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.413736:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9efa6 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.413746:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8951f512bf00) 00010000:00010000:1.0:1787785008.413748:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787785008.413751:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9efa6 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.413756:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9efa6 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787785008.416941:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785008.417049:0:24179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728156928 00000100:00100000:3.0:1787785008.417059:0:24179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728156928 00000100:00100000:3.0:1787785008.417119:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:3.0:1787785008.417130:0:24179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+7:2405:x1874627728156928:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787785008.417464:0:24179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+7:2405:x1874627728156928:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 Request processed in 335us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785008.417473:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:1.0:1787785008.422073:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785008.422259:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728157184 00000100:00100000:2.0:1787785008.422271:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728157184 00000100:00100000:2.0:1787785008.422337:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 69 00000100:00100000:2.0:1787785008.422357:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+14:18824:x1874627728157184:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787785008.422417:0:22670:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787785008.422455:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951c0031800/0x88ace7295d9efbb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73115 expref: 14 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.422476:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8951f512bf00) 00010000:00010000:2.0:1787785008.422495:0:22670:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787785008.422528:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629e00/0x88ace7295d9efc9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.422542:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629e00/0x88ace7295d9efc9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.422675:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629e00/0x88ace7295d9efc9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787785008.422846:0:22670:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d86cd9d3 reply state 00000000c0618dfe transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629e00/0x88ace7295d9efc9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.422860:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629e00/0x88ace7295d9efc9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.422867:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8951f512bf00) 00010000:00010000:2.0:1787785008.422870:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787785008.422873:0:22670:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787785008.422972:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+15:18824:x1874627728157184:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 625us (909us total) trans 12884901919 rc 0/0 00000100:00100000:2.0:1787785008.422980:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 69 00000100:00100000:0.0:1787785008.430729:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785008.430851:0:24684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728157312 00000100:00100000:2.0:1787785008.430861:0:24684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728157312 00000100:00100000:2.0:1787785008.430921:0:24684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:2.0:1787785008.430931:0:24684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+7:18824:x1874627728157312:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787785008.430950:0:24684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787785008.430970:0:24684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9efd0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e73123 expref: -99 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.431027:0:24684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000023e8a2e3/0x88ace7295d9efc2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7311c expref: 8 pid: 24179 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.431037:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787785008.431041:0:24684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787785008.431047:0:24684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9efd0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73123 expref: 8 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.431081:0:24684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000023e8a2e3/0x88ace7295d9efc2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7311c expref: 8 pid: 24179 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.431095:0:24684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000023e8a2e3/0x88ace7295d9efc2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7311c expref: 8 pid: 24179 timeout: 848 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787785008.431109:0:24684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24684:1874627750282368:192.168.202.41@tcp:104: 00000100:00100000:2.0:1787785008.431199:0:24684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951df66f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787785008.436156:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785008.436339:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728157440 00000100:00100000:3.0:1787785008.436358:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728157440 00010000:00010000:3.0:1787785008.436400:0:22655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000023e8a2e3/0x88ace7295d9efc2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7311c expref: 9 pid: 24179 timeout: 848 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787785008.436451:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:3.0:1787785008.436462:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+9:2406:x1874627728157440:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787785008.436478:0:22655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787785008.436499:0:22655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000023e8a2e3/0x88ace7295d9efc2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7311c expref: 9 pid: 24179 timeout: 848 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.436512:0:22655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000023e8a2e3/0x88ace7295d9efc2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7311c expref: 9 pid: 24179 timeout: 848 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.436729:0:22655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787785008.436736:0:22655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787785008.436744:0:22655:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9efd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73123 expref: 9 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.436756:0:22655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9efd0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73123 expref: 9 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.436842:0:22655:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9efd0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73123 expref: 9 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787785008.436859:0:22655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c33852c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:22655:1874627750282496:192.168.202.41@tcp:105: 00000100:00100000:3.0:1787785008.436941:0:22655:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e32c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787785008.440337:0:22655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c33852c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:22655:1874627750282496:192.168.202.41@tcp:105: 00010000:00010000:3.0:1787785008.440375:0:22655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787785008.440445:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+9:2406:x1874627728157440:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 3983us (4298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785008.440457:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00010000:00010000:2.0:1787785008.442257:0:24684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023e8a2e3/0x88ace7295d9efc2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7311c expref: 8 pid: 24179 timeout: 848 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787785008.442287:0:24684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b2940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24684:1874627750282368:192.168.202.41@tcp:104: 00010000:00010000:2.0:1787785008.442316:0:24684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9efd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73123 expref: 7 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.442364:0:24684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628400, rc 0) 00000100:00100000:2.0:1787785008.442426:0:24684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+7:18824:x1874627728157312:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 11496us (11707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785008.442446:0:24684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:1.0:1787785008.446819:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785008.446942:0:24182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728157568 00000100:00100000:2.0:1787785008.446953:0:24182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728157568 00000100:00100000:2.0:1787785008.447021:0:24182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:2.0:1787785008.447031:0:24182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+7:2407:x1874627728157568:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787785008.447180:0:24182:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787785008.447184:0:24182:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1787785007 00002000:00010000:2.0:1787785008.447186:0:24182:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1787785005 00002000:00010000:2.0:1787785008.447188:0:24182:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787785008 -> 1787785007 00002000:00010000:2.0:1787785008.447190:0:24182:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787785008.447261:0:24182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+8:2407:x1874627728157568:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 231us (501us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1787785008.447269:0:24182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:0.0:1787785008.452001:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787785008.452129:0:24181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728157696 00000100:00100000:1.0:1787785008.452141:0:24181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728157696 00000100:00100000:1.0:1787785008.452246:0:24181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:1.0:1787785008.452258:0:24181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+8:2408:x1874627728157696:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787785008.452304:0:24181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9efd7 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.452323:0:24181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9efd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73123 expref: 8 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.452332:0:24181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787785008.452336:0:24181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787785008.452341:0:24181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9efd7 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.452420:0:24181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9efd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73123 expref: 8 pid: 24684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.452442:0:24181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9efd0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73123 expref: 8 pid: 24684 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787785008.452458:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5629680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24181:1874627750282624:192.168.202.41@tcp:104: 00000100:00100000:1.0:1787785008.452543:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d1db7480 going to sleep for 11 seconds 00000100:00100000:3.0:1787785008.459918:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5629680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24181:1874627750282624:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787785008.459953:0:24181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9efd7 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787785008.461892:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785008.462069:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728157824 00000100:00100000:3.0:1787785008.462095:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728157824 00010000:00010000:3.0:1787785008.462142:0:22657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9efd0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73123 expref: 9 pid: 24684 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787785008.462236:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:3.0:1787785008.462247:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+9:2405:x1874627728157824:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787785008.462263:0:22657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787785008.462287:0:22657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9efd0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73123 expref: 9 pid: 24684 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.462303:0:22657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9efd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73123 expref: 9 pid: 24684 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.462327:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c782f59/0x88ace7295d9efd0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73123 expref: 9 pid: 24684 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.462345:0:22657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787785008.462361:0:22657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787785008.462367:0:22657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9efd7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.462377:0:22657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9efd7 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.462416:0:22657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787785008.462488:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+8:2405:x1874627728157824:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 243us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785008.462506:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00010000:00010000:1.0:1787785008.462867:0:24181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9efd7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.462877:0:24181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9efd7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.462899:0:24181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9efd7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.462908:0:24181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9efd7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.462916:0:24181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9efd7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.462923:0:24181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d35600 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787785008.462935:0:24181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9efd7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.462945:0:24181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9efd7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.462958:0:24181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9efd7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.462966:0:24181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9efd7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787785008.463037:0:24181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+7:2408:x1874627728157696:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 Request processed in 10781us (11046us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785008.463045:0:24181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:0.0:1787785008.467475:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785008.467831:0:25465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728158080 00000100:00100000:3.0:1787785008.467842:0:25465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728158080 00000100:00100000:3.0:1787785008.467908:0:25465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 70 00000100:00100000:3.0:1787785008.467919:0:25465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+15:18824:x1874627728158080:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787785008.468018:0:25465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9efde lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.468038:0:25465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9eeb1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730c1 expref: 15 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.468050:0:25465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9efde lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.468091:0:25465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9eeb1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730c1 expref: 15 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.468108:0:25465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9eeb1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730c1 expref: 15 pid: 22671 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787785008.468124:0:25465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c33852c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25465:1874627750282752:192.168.202.41@tcp:104: 00000100:00100000:3.0:1787785008.468205:0:25465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e32c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787785008.472318:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787785008.472543:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728158208 00000100:00100000:0.0:1787785008.472562:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728158208 00010000:00010000:0.0:1787785008.472606:0:22655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9eeb1 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730c1 expref: 16 pid: 22671 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787785008.472653:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:0.0:1787785008.472662:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+16:2406:x1874627728158208:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787785008.472679:0:22655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787785008.472687:0:22655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9eeb1 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730c1 expref: 16 pid: 22671 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785008.472701:0:22655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9eeb1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730c1 expref: 16 pid: 22671 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785008.472742:0:22655:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:0.0:1787785008.472749:0:22655:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628a00/0x88ace7295d9ef44 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730f2 expref: 16 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785008.472758:0:22655:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9efde lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785008.472806:0:22655:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9efde lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785008.472815:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9efde lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787785008.472840:0:22655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787785008.472893:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+16:2406:x1874627728158208:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 232us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787785008.472901:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00010000:00010000:3.0:1787785008.473797:0:25465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9eeb1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730c1 expref: 15 pid: 22671 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787785008.473819:0:25465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c33852c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25465:1874627750282752:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787785008.473842:0:25465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9efde lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.473860:0:25465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9efde lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.473867:0:25465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9efde lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.474073:0:25465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9efe5 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.474087:0:25465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9efad lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7310e expref: 15 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.474095:0:25465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9efe5 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.474128:0:25465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9efad lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7310e expref: 15 pid: 25465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.474142:0:25465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9efad lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7310e expref: 15 pid: 25465 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787785008.474157:0:25465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c33852c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25465:1874627750282880:192.168.202.41@tcp:104: 00000100:00100000:3.0:1787785008.474228:0:25465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e32540 going to sleep for 11 seconds 00000100:00100000:2.0:1787785008.481536:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785008.482533:0:25465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c33852c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25465:1874627750282880:192.168.202.41@tcp:104: 00010000:00010000:3.0:1787785008.482576:0:25465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9efe5 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787785008.482964:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728158336 00000100:00100000:0.0:1787785008.482975:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728158336 00010000:00010000:1.0:1787785008.483157:0:22657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9efad lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7310e expref: 16 pid: 25465 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787785008.483363:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:1.0:1787785008.483375:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3653050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+16:2406:x1874627728158336:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787785008.483395:0:22657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787785008.483404:0:22657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9efad lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7310e expref: 16 pid: 25465 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.483419:0:22657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9efad lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7310e expref: 16 pid: 25465 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.483531:0:22657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712400/0x88ace7295d9efad lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7310e expref: 16 pid: 25465 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.483548:0:22657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8951f512bf00) 00010000:00010000:1.0:1787785008.483620:0:22657:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9efe5 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.483632:0:22657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9efe5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.483641:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9efe5 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.483705:0:22657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787785008.483793:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3653050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+15:2406:x1874627728158336:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 396us (2244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785008.483803:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00010000:00010000:3.0:1787785008.485667:0:25465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9efe5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787785008.485702:0:25465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9efe5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787785008.486130:0:25465:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:0.0:1787785008.486527:0:25465:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:0.0:1787785008.486641:0:25465:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:0.0:1787785008.486737:0:25465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951cffc8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25465:1874627750283008:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787785008.487096:0:25465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787785008.487164:0:25465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951c4e33480 going to sleep for 11 seconds 00000100:00100000:2.0:1787785008.487204:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750283008 00000100:00100000:2.0:1787785008.487212:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750283008 00000100:00100000:2.0:1787785008.487376:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787785008.487387:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c562a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:25465:x1874627750283008:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787785008.487869:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c562a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:25465:x1874627750283008:12345-0@lo:1000:mdt00_003.0 Request processed in 166us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785008.487895:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787785008.487980:0:25465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951cffc8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25465:1874627750283008:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787785008.488168:0:25465:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:1.0:1787785008.488236:0:25465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c56283c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25465:1874627750283136:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787785008.488272:0:25465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787785008.488598:0:25465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d1db7000 going to sleep for 11 seconds 00000100:00100000:0.0:1787785008.488737:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750283136 00000100:00100000:0.0:1787785008.488743:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750283136 00000100:00100000:0.0:1787785008.488812:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787785008.488822:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c56292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:25465:x1874627750283136:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787785008.488966:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c56292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:25465:x1874627750283136:12345-0@lo:1000:mdt00_003.0 Request processed in 145us (693us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1787785008.488986:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787785008.489137:0:25465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c56283c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25465:1874627750283136:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787785008.489177:0:25465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9efe5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.489199:0:25465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9efe5 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.489208:0:25465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9efe5 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.489215:0:25465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787785008.489220:0:25465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9efe5 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.489241:0:25465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9efe5 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.489259:0:25465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8951f512bf00) 00010000:00010000:1.0:1787785008.489262:0:25465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787785008.489268:0:25465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9efe5 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.489274:0:25465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712800/0x88ace7295d9efe5 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.489306:0:25465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9ef3d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.489313:0:25465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9ef3d lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.489319:0:25465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9ef3d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.489325:0:25465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3713600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787785008.489335:0:25465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9ef3d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.489342:0:25465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9ef3d lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.489362:0:25465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:1.0:1787785008.489365:0:25465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787785008.489372:0:25465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628a00/0x88ace7295d9ef44 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730f2 expref: 18 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.489385:0:25465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628a00/0x88ace7295d9ef44 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730f2 expref: 18 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.489393:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628a00/0x88ace7295d9ef44 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730f2 expref: 18 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.489584:0:25465:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628a00/0x88ace7295d9ef44 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e730f2 expref: 18 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787785008.489599:0:25465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5629a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25465:1874627750283264:192.168.202.41@tcp:105: 00000100:00100000:1.0:1787785008.489669:0:25465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8951d1db7480 going to sleep for 11 seconds 00000100:00100000:1.0:1787785008.494253:0:25465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5629a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25465:1874627750283264:192.168.202.41@tcp:105: 00010000:00010000:1.0:1787785008.494307:0:25465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9ef3d lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.494318:0:25465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3713600/0x88ace7295d9ef3d lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.494384:0:25465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35600/0x88ace7295d9efec lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.494403:0:25465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35600/0x88ace7295d9efec lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.494416:0:25465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35600/0x88ace7295d9efec lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.494428:0:25465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35600/0x88ace7295d9efec lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.494445:0:25465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35600/0x88ace7295d9efec lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.494452:0:25465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35600/0x88ace7295d9efec lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.494457:0:25465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951e1d35600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787785008.494461:0:25465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35600/0x88ace7295d9efec lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.494469:0:25465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35600/0x88ace7295d9efec lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.494481:0:25465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:1.0:1787785008.494484:0:25465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787785008.494488:0:25465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35600/0x88ace7295d9efec lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.494493:0:25465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951e1d35600/0x88ace7295d9efec lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.494512:0:25465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9efde lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.494518:0:25465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9efde lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.494524:0:25465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9efde lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.494529:0:25465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c3712000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1787785008.494532:0:25465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9efde lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.494539:0:25465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9efde lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.494548:0:25465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:1.0:1787785008.494561:0:25465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787785008.494564:0:25465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9efde lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.494570:0:25465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c3712000/0x88ace7295d9efde lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787785008.494749:0:25465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+18:18824:x1874627728158080:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 26829us (27283us total) trans 12884901924 rc 0/0 00000100:00100000:1.0:1787785008.494760:0:25465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 70 00000020:00080000:1.0:1787785008.494804:0:25465:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787785008.495135:0:22705:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787785008.495140:0:22705:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787785008.495156:0:22705:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1787785008.495163:0:22705:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1787785008.498400:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785008.498670:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728158464 00000100:00100000:2.0:1787785008.498681:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728158464 00000100:00100000:2.0:1787785008.498742:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:2.0:1787785008.498753:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951cffc8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+18:18823:x1874627728158464:12345-192.168.202.41@tcp:49:bash.0 00000100:00100000:2.0:1787785008.498919:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951cffc8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+18:18823:x1874627728158464:12345-192.168.202.41@tcp:49:bash.0 Request processed in 167us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785008.498928:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:0.0:1787785008.504567:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1787785008.504612:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1787785008.504813:0:24182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728158848 00000100:00100000:1.0:1787785008.504822:0:24182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728158848 00000100:00100000:1.0:1787785008.504895:0:24182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:1.0:1787785008.504905:0:24182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+7:18823:x1874627728158848:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:1.0:1787785008.504923:0:24182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787785008.504944:0:24182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9eff3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e7312a expref: -99 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787785008.504971:0:24182:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a8f6f2f, atime: 0x6a8f6f2d, ctime: 0x6a8f6f2f, blocks: 0x0 00010000:00010000:1.0:1787785008.504994:0:24182:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=748s v=(0 0) 00010000:00010000:1.0:1787785008.504999:0:24182:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787785008.505020:0:24182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9eff3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7312a expref: 8 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.505038:0:24182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f18b5314/0x88ace7295d9eff3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e7312a expref: 8 pid: 24182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.505051:0:24182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951e1d35600, rc 0) 00000100:00100000:1.0:1787785008.505102:0:24182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+8:18823:x1874627728158848:12345-192.168.202.41@tcp:101:bash.0 Request processed in 199us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785008.505110:0:24182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:2.0:1787785008.505375:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728158720 00000100:00100000:2.0:1787785008.505379:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728158720 00000100:00100000:2.0:1787785008.505415:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:2.0:1787785008.505422:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd7c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+18:18824:x1874627728158720:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787785008.505672:0:22673:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787785008.505706:0:22673:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:2.0:1787785008.505733:0:22673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9effa lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.505746:0:22673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9effa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.505755:0:22673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9effa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.505762:0:22673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9effa lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.505813:0:22673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9effa lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.505819:0:22673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9effa lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.505831:0:22673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787785008.505877:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd7c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+20:18824:x1874627728158720:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 455us (1332us total) trans 12884901926 rc 0/0 00000100:00100000:2.0:1787785008.505884:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00000020:00080000:2.0:1787785008.505888:0:22673:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787785008.506031:0:23827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787785008.506038:0:23827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9effa lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.506046:0:23827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629a00 already unused, calling callback (ffffffffc0d5f420) 00010000:00010000:1.0:1787785008.506050:0:23827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9effa lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.506059:0:23827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9effa lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.506077:0:23827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8951f512bf00) 00010000:00010000:1.0:1787785008.506080:0:23827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787785008.506086:0:23827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9effa lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.506092:0:23827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9effa lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787785008.506105:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787785008.506106:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787785008.506108:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787785008.511870:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785008.512254:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728158976 00000100:00100000:2.0:1787785008.512264:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728158976 00000100:00100000:2.0:1787785008.512325:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 71 00000100:00100000:2.0:1787785008.512336:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951c5629a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+20:18823:x1874627728158976:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1787785008.512371:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787785008.512393:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9f001 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e73131 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.512440:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9f008 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.512454:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9f008 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.512466:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9f008 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.512797:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9f001 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73131 expref: 22 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.512823:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1628400/0x88ace7295d9f008 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73131 expref: 21 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.512832:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:2.0:1787785008.512835:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787785008.512838:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1628400, rc 0) 00000100:00100000:2.0:1787785008.512904:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951c5629a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+21:18823:x1874627728158976:12345-192.168.202.41@tcp:101:bash.0 Request processed in 570us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785008.512912:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 71 00000100:00100000:0.0:1787785008.517917:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785008.518706:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728159232 00000100:00100000:2.0:1787785008.518719:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728159232 00000100:00100000:2.0:1787785008.518804:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:2.0:1787785008.518815:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff020780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+21:18823:x1874627728159232:12345-192.168.202.41@tcp:35:bash.0 00000001:00080000:2.0:1787785008.519044:0:22673:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:2.0:1787785008.519129:0:22673:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:2.0:1787785008.519251:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff020780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+24:18823:x1874627728159232:12345-192.168.202.41@tcp:35:bash.0 Request processed in 436us (1346us total) trans 12884901929 rc 0/0 00000100:00100000:2.0:1787785008.519268:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 14 00000020:00080000:2.0:1787785008.519274:0:22673:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787785008.672571:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785008.673399:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728159488 00000100:00100000:2.0:1787785008.673411:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728159488 00000100:00100000:2.0:1787785008.673501:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 72 00000100:00100000:2.0:1787785008.673511:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+24:18834:x1874627728159488:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1787785008.673536:0:22671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787785008.673757:0:22671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9f00f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4d8624697e73138 expref: -99 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787785008.673892:0:22671:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787785008.673988:0:22671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9f00f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73138 expref: 26 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.674069:0:22671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8950c23c7400) 00010000:00010000:2.0:1787785008.674073:0:22671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787785008.674080:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629000/0x88ace7295d9f00f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0xd4d8624697e73138 expref: 26 pid: 22671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.674097:0:22671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8951d1629000, rc 0) 00000100:00100000:2.0:1787785008.674176:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+25:18834:x1874627728159488:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 666us (1626us total) trans 12884901930 rc 301/301 00000100:00100000:2.0:1787785008.674184:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 72 00000100:00100000:0.0:1787785008.680675:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785008.680800:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728159616 00000100:00100000:2.0:1787785008.680809:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728159616 00000100:00100000:2.0:1787785008.680922:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 73 00000100:00100000:2.0:1787785008.680932:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff021a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+25:18834:x1874627728159616:12345-192.168.202.41@tcp:34:lfs.0 00010000:00010000:2.0:1787785008.681018:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9f01d lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681034:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9f01d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681046:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9f01d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681061:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9f024 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681081:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9f024 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681088:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9f024 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681161:0:22670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9f02b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681170:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9f02b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681177:0:22670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9f02b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787785008.681234:0:22670:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9f02b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681250:0:22670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9f01d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681256:0:22670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9f01d lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681274:0:22670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9f01d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681280:0:22670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787785008.681284:0:22670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9f01d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681292:0:22670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9f01d lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681312:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8951f512b400) 00010000:00010000:2.0:1787785008.681315:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787785008.681319:0:22670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9f01d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681325:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629400/0x88ace7295d9f01d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681339:0:22670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9f024 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681345:0:22670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9f024 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681359:0:22670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9f024 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681365:0:22670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8951d1629a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787785008.681368:0:22670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9f024 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681373:0:22670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9f024 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681381:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8951f5138e00) 00010000:00010000:2.0:1787785008.681383:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787785008.681385:0:22670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9f024 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681390:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8951d1629a00/0x88ace7295d9f024 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681419:0:22670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9f02b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681424:0:22670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9f02b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681699:0:22670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9f02b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681705:0:22670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8950c4182a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1787785008.681708:0:22670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9f02b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681714:0:22670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9f02b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681723:0:22670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8951c133c000) 00010000:00010000:2.0:1787785008.681725:0:22670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787785008.681728:0:22670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9f02b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787785008.681734:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8950c4182a00/0x88ace7295d9f02b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22670 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787785008.683912:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff021a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+25:18834:x1874627728159616:12345-192.168.202.41@tcp:34:lfs.0 Request processed in 2969us (3234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785008.683927:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 73 00000100:00100000:0.0:1787785008.687067:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785008.687199:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728159872 00000100:00100000:3.0:1787785008.687209:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728159872 00000100:00100000:3.0:1787785008.687283:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:3.0:1787785008.687294:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951ff0230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+25:18834:x1874627728159872:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:3.0:1787785008.687708:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951ff0230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+26:18834:x1874627728159872:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 415us (650us total) trans 12884901931 rc 0/0 00000100:00100000:3.0:1787785008.687718:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:3.0:1787785008.774366:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787785008.774393:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d1b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750283392:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787785008.774472:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787785008.774786:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c562b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750283648:0@lo:400:kworker.0 00000100:00100000:1.0:1787785008.774818:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787785008.774837:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e6212d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750284160:0@lo:400:kworker.0 00000100:00100000:1.0:1787785008.774855:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787785008.774872:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e62103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750284672:0@lo:400:kworker.0 00000100:00100000:1.0:1787785008.774895:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787785008.774912:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787785008.774917:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5629680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750283776:0@lo:400:kworker.0 00000100:00100000:1.0:1787785008.774936:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787785008.774949:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e6211a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750284288:0@lo:400:kworker.0 00000100:00100000:1.0:1787785008.774965:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787785008.774978:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e6212580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750284800:0@lo:400:kworker.0 00000100:00100000:1.0:1787785008.774994:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787785008.775042:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750283648 00000100:00100000:3.0:1787785008.775240:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951c5628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e11354d-250d-4393-8e0e-7593eb008ce7:3645:1874627750283520:0@lo:400:kworker.0 00000100:00100000:3.0:1787785008.775273:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787785008.775296:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb256580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750284032:0@lo:400:kworker.0 00000100:00100000:3.0:1787785008.775316:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787785008.775332:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e6213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750284544:0@lo:400:kworker.0 00000100:00100000:3.0:1787785008.775361:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787785008.775378:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787785008.775384:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951fb2543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750283904:0@lo:400:kworker.0 00000100:00100000:3.0:1787785008.775404:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787785008.775422:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e6210780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750284416:0@lo:400:kworker.0 00000100:00100000:3.0:1787785008.775443:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787785008.775464:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e62130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750284928:0@lo:400:kworker.0 00000100:00100000:3.0:1787785008.775487:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787785008.775506:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750284160 00000100:00100000:3.0:1787785008.775513:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750284160 00000100:00100000:3.0:1787785008.775575:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787785008.775584:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e6210f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750284160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787785008.775644:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e6210f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750284160:12345-0@lo:400:kworker.0 Request processed in 61us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785008.775652:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787785008.775693:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e6212d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750284160:0@lo:400:kworker.0 00000100:00100000:3.0:1787785008.775942:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750284672 00000100:00100000:3.0:1787785008.775946:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750284672 00000100:00080000:3.0:1787785008.775973:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787785008.775994:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750284800 00000100:00100000:3.0:1787785008.775997:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750284800 00000100:00080000:3.0:1787785008.776018:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787785008.776032:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750284032 00000100:00100000:3.0:1787785008.776034:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750284032 00000100:00100000:3.0:1787785008.776045:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750284544 00000100:00100000:3.0:1787785008.776047:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750284544 00000100:00080000:3.0:1787785008.776057:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787785008.776070:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750284416 00000100:00100000:3.0:1787785008.776073:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750284416 00000100:00100000:3.0:1787785008.776083:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750284928 00000100:00100000:3.0:1787785008.776085:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750284928 00000100:00080000:3.0:1787785008.776107:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787785008.776122:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787785008.776128:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e6213840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750284672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787785008.776166:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e6213840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874627750284672:12345-0@lo:400:kworker.0 Request processed in 38us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785008.776182:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1787785008.776648:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951e62103c0 x1874627750284672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787785024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787785008.776663:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e62103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1874627750284672:0@lo:400:kworker.0 00000100:00100000:3.0:1787785008.776695:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787785008.776703:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e6213c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750284800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787785008.776744:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e6213c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874627750284800:12345-0@lo:400:kworker.0 Request processed in 42us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785008.776750:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787785008.776805:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e6212580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1874627750284800:0@lo:400:kworker.0 00000100:00100000:3.0:1787785008.776823:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787785008.776881:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750283648 00000100:00100000:0.0:1787785008.776983:0:24184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750283392 00000100:00100000:0.0:1787785008.776988:0:24184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750283392 00000100:00100000:2.0:1787785008.777924:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787785008.782083:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787785008.782120:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e62121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750283648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787785008.782262:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e62121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874627750283648:12345-0@lo:400:kworker.0 Request processed in 162us (7442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785008.782271:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787785008.782321:0:24181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750283776 00000100:00100000:1.0:1787785008.782330:0:24181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750283776 00000100:00100000:1.0:1787785008.782380:0:24181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750284288 00000100:00100000:1.0:1787785008.782384:0:24181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750284288 00000100:00100000:1.0:1787785008.782398:0:24181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750283904 00000100:00100000:1.0:1787785008.782401:0:24181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750283904 00000100:00100000:1.0:1787785008.782420:0:24181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787785008.782426:0:24181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e6211680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1874627750283776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787785008.782478:0:24181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e6211680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1874627750283776:12345-0@lo:400:kworker.0 Request processed in 51us (7540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785008.782485:0:24181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787785008.782497:0:24181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787785008.782503:0:24181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951e6212940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750284288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787785008.782530:0:24181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951e6212940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750284288:12345-0@lo:400:kworker.0 Request processed in 28us (7564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785008.782535:0:24181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787785008.782545:0:24181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787785008.782560:0:24181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c33861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750283904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787785008.782589:0:24181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c33861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874627750283904:12345-0@lo:400:kworker.0 Request processed in 39us (7183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785008.782594:0:24181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787785008.782721:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5629680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750283776:0@lo:400:kworker.0 00000100:00100000:1.0:1787785008.782738:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e6211a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750284288:0@lo:400:kworker.0 00000100:00100000:1.0:1787785008.782750:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c562b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1874627750283648:0@lo:400:kworker.0 00000100:00100000:1.0:1787785008.782834:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787785008.782843:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3384b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750284544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787785008.782878:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3384b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874627750284544:12345-0@lo:400:kworker.0 Request processed in 37us (7516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785008.782884:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787785008.782901:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787785008.782908:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750284416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787785008.782937:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874627750284416:12345-0@lo:400:kworker.0 Request processed in 30us (7494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785008.782943:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787785008.782954:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787785008.782960:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3272580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750284928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787785008.782984:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3272580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874627750284928:12345-0@lo:400:kworker.0 Request processed in 24us (7496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785008.782989:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1787785008.783025:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787785008.783039:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750283520 00000100:00100000:1.0:1787785008.783043:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750283520 00000100:00100000:1.0:1787785008.783070:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787785008.783076:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+24:3645:x1874627750283520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787785008.783105:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e11354d-250d-4393-8e0e-7593eb008ce7+24:3645:x1874627750283520:12345-0@lo:400:kworker.0 Request processed in 29us (7830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785008.783120:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787785008.784836:0:24184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787785008.784864:0:24184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c33852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750283392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787785008.784901:0:24184:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787785008.784976:0:24184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c33852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874627750283392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (10503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785008.785284:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb2543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1874627750283904:0@lo:400:kworker.0 00000100:00100000:1.0:1787785008.785300:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e6210780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874627750284416:0@lo:400:kworker.0 00010000:00080000:1.0:1787785008.785313:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8951e62130c0 x1874627750284928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787785024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787785008.785324:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e62130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1874627750284928:0@lo:400:kworker.0 00000100:00100000:1.0:1787785008.785336:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951c5628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e11354d-250d-4393-8e0e-7593eb008ce7:3645:1874627750283520:0@lo:400:kworker.0 00000100:00100000:1.0:1787785008.785358:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e6213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1874627750284544:0@lo:400:kworker.0 00000100:00100000:1.0:1787785008.785381:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d1b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1874627750283392:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787785008.787150:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c3384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750284032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787785008.788881:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c3384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874627750284032:12345-0@lo:400:kworker.0 Request processed in 12045us (13556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787785008.788895:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787785008.789040:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951fb256580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874627750284032:0@lo:400:kworker.0 00000100:00100000:0.0:1787785008.789144:0:24184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787785008.789390:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8950c43b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750285056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787785008.790320:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787785008.796838:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750285056 00000100:00100000:1.0:1787785008.796852:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750285056 00000100:00100000:1.0:1787785008.799611:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787785008.799636:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750285056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787785008.799667:0:24183:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787785008.799758:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1874627750285056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (9440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785008.799795:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787785008.799921:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8950c43b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1874627750285056:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787785008.839534:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787785009.862041:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787785010.864361:0:25754:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:1.0:1787785010.889159:0:23827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787785010.979931:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785010.979979:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785010.980003:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785010.980023:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785010.980040:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785010.980056:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785010.980074:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785010.980093:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785010.980116:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785010.980145:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728160000 00000100:00100000:2.0:1787785010.980155:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728160000 00000100:00100000:2.0:1787785010.980208:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 167 00000100:00100000:2.0:1787785010.980220:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951fd677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+13:2407:x1874627728160000:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787785010.980299:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951fd677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1c1bb492-200e-444d-8679-4c80592d7d80+13:2407:x1874627728160000:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 82us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785010.980307:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 167 00000100:00100000:2.0:1787785010.980351:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728160128 00000100:00100000:2.0:1787785010.980354:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728160128 00000100:00100000:2.0:1787785010.980384:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728160256 00000100:00100000:2.0:1787785010.980387:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728160256 00000100:00100000:2.0:1787785010.980400:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728160640 00000100:00100000:2.0:1787785010.980402:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728160640 00000100:00100000:2.0:1787785010.980413:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728160768 00000100:00100000:2.0:1787785010.980415:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728160768 00000100:00100000:2.0:1787785010.980428:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:2.0:1787785010.980434:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+26:2408:x1874627728160128:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787785010.980467:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+26:2408:x1874627728160128:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 33us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785010.980481:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:2.0:1787785010.980494:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 62 00000100:00100000:2.0:1787785010.980500:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+5:2407:x1874627728160256:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787785010.980526:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+5:2407:x1874627728160256:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 26us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785010.980532:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 62 00000100:00100000:2.0:1787785010.980544:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:2.0:1787785010.980550:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:2408:x1874627728160640:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787785010.980575:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:315a9816-a5f4-4529-af39-1b0e9b8aed4e+6:2408:x1874627728160640:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 25us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785010.980581:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:2.0:1787785010.980592:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 64 00000100:00100000:2.0:1787785010.980597:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:315a9816-a5f4-4529-af39-1b0e9b8aed4e+5:2407:x1874627728160768:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1787785010.980617:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:315a9816-a5f4-4529-af39-1b0e9b8aed4e+5:2407:x1874627728160768:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 20us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787785010.980623:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 64 00000100:00100000:1.0:1787785010.980696:0:24181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728160384 00000100:00100000:1.0:1787785010.980706:0:24181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728160384 00000100:00100000:1.0:1787785010.980729:0:24181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728160512 00000100:00100000:1.0:1787785010.980732:0:24181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728160512 00000100:00100000:1.0:1787785010.980742:0:24181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728160896 00000100:00100000:1.0:1787785010.980744:0:24181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728160896 00000100:00100000:1.0:1787785010.980754:0:24181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728161024 00000100:00100000:1.0:1787785010.980757:0:24181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728161024 00000100:00100000:1.0:1787785010.980808:0:24181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:1.0:1787785010.980816:0:24181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+8:2408:x1874627728160384:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787785010.980844:0:24181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+8:2408:x1874627728160384:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 30us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785010.980849:0:24181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:1.0:1787785010.980862:0:24181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:1.0:1787785010.980868:0:24181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+5:2407:x1874627728160512:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787785010.980906:0:24181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+5:2407:x1874627728160512:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 38us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785010.980913:0:24181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:1.0:1787785010.980926:0:24181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:1.0:1787785010.980931:0:24181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+5:2408:x1874627728160896:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787785010.980949:0:24181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+5:2408:x1874627728160896:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 19us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785010.980956:0:24181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:1.0:1787785010.980966:0:24181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:1.0:1787785010.980971:0:24181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+5:2407:x1874627728161024:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1787785010.980988:0:24181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:315a9816-a5f4-4529-af39-1b0e9b8aed4e+5:2407:x1874627728161024:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 17us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785010.981000:0:24181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00080000:1.0:1787785010.981034:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787785010.981038:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787785010.981041:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787785010.981043:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787785011.909961:0:22658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787785011.999697:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1787785011.999753:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1787785011.999888:0:24185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728161152 00000100:00100000:2.0:1787785011.999898:0:24185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728161152 00002000:00100000:2.0:1787785011.999944:0:24185:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff8951d9e11e00 x1874627728161152/t0(0) o4->3afbc3a9-7189-4bc3-a69b-cd7ebe093899@192.168.202.41@tcp:137/0 lens 504/0 e 0 to 0 dl 1787785022 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787785011.999956:0:24185:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8951d9e11e00 with x1874627728161152 ext(0->8) 00002000:00010000:2.0:1787785011.999962:0:24185:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8951d9e11e00 00000100:00100000:2.0:1787785012.000003:0:24185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:2.0:1787785012.000028:0:24185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e11e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+8:2405:x1874627728161152:12345-192.168.202.41@tcp:4:bash.0 00000100:00100000:1.0:1787785012.000940:0:24181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627728161280 00000100:00100000:1.0:1787785012.000946:0:24181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627728161280 00000100:00100000:1.0:1787785012.001007:0:24181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:1.0:1787785012.001016:0:24181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8951d9e130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+11:2405:x1874627728161280:12345-192.168.202.41@tcp:16:kworker.0 00000100:00080000:2.0:1787785012.001376:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787785012.003154:0:24185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e11e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+11:2405:x1874627728161152:12345-192.168.202.41@tcp:4:bash.0 Request processed in 3117us (3456us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1787785012.003171:0:24185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00002000:00100000:3.0:1787785012.003184:0:24185:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff8951d9e11e00 x1874627728161152/t12884901895(0) o4->3afbc3a9-7189-4bc3-a69b-cd7ebe093899@192.168.202.41@tcp:137/0 lens 504/448 e 0 to 0 dl 1787785022 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1787785012.003194:0:24185:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8951d9e11e00 with x1874627728161152 ext(0->8) 00002000:00010000:3.0:1787785012.003209:0:24185:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8951d9e11e00 00000001:00080000:0.0:1787785012.007652:0:24176:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:0.0:1787785012.007673:0:24176:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00000100:00100000:1.0:1787785012.008135:0:24181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8951d9e130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3afbc3a9-7189-4bc3-a69b-cd7ebe093899+6:2405:x1874627728161280:12345-192.168.202.41@tcp:16:kworker.0 Request processed in 7112us (8374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787785012.008147:0:24181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:2.0:1787785012.870145:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787785012.870172:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951e62130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750285184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787785012.870255:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787785012.870699:0:24184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750285184 00000100:00100000:0.0:1787785012.870708:0:24184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750285184 00000100:00100000:0.0:1787785012.870807:0:24184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787785012.870818:0:24184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c43b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750285184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787785012.870841:0:24184:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923505152 avail 3691954176 00000100:00100000:0.0:1787785012.870898:0:24184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c43b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874627750285184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787785012.870921:0:24184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787785012.870984:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:0.0:1787785012.870990:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8951c5628b40, transno 12884901892 00000004:00080000:0.0:1787785012.870999:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:0.0:1787785012.871024:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951e62130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1874627750285184:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787785012.871298:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787785012.871527:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787785012.871537:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750285312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787785012.871578:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787785012.873143:0:24184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627750285312 00000100:00100000:0.0:1787785012.873156:0:24184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627750285312 00000100:00100000:0.0:1787785012.873234:0:24184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787785012.873244:0:24184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8950c339c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750285312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787785012.873265:0:24184:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923505152 avail 3691954176 00000100:00100000:0.0:1787785012.873348:0:24184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8950c339c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874627750285312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (1769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787785012.873624:0:24184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1787785012.873690:0:22665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787785012.874036:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8951d9e12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1874627750285312:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787785012.938124:0:22659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14420 lines, 14420 kept, 0 dropped, 0 bad.