00000100:00100000:1.0F:1787784689.460800:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643164032:0@lo:400:kworker.0 00000100:00100000:1.0:1787784689.460879:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784689.460945:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784689.460951:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431891612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643164160:0@lo:400:kworker.0 00000100:00100000:1.0:1787784689.460975:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0F:1787784689.461094:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189161a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643163776:0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.461135:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784689.461170:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189163c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643164288:0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.461193:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784689.461215:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787784689.461220:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189161680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643163904:0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.461242:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784689.461256:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643164416:0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.461276:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784689.461305:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643164160 00000100:00100000:0.0:1787784689.461312:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643164160 00000100:00100000:0.0:1787784689.461384:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643164288 00000100:00100000:0.0:1787784689.461388:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643164288 00000100:00100000:0.0:1787784689.461414:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643164416 00000100:00100000:0.0:1787784689.461417:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643164416 00000100:00100000:0.0:1787784689.461433:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787784689.461441:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189160b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643164160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.461492:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189160b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643164160:12345-0@lo:400:kworker.0 Request processed in 51us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784689.461498:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787784689.461515:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787784689.461520:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643164288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.461571:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643164288:12345-0@lo:400:kworker.0 Request processed in 51us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784689.461577:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787784689.461591:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787784689.461596:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643164416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.461634:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643164416:12345-0@lo:400:kworker.0 Request processed in 37us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784689.461640:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1787784689.461664:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784689.461692:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643164416:0@lo:400:kworker.0 00000100:00100000:0.0:1787784689.461702:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189163c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643164288:0@lo:400:kworker.0 00000100:00100000:3.0F:1787784689.461976:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643164032 00000100:00100000:3.0:1787784689.461987:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643164032 00000100:00100000:3.0:1787784689.462026:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643163904 00000100:00100000:3.0:1787784689.462029:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643163904 00000100:00100000:3.0:1787784689.462046:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787784689.462052:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189162580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643164032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784689.462086:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189162580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643164032:12345-0@lo:400:kworker.0 Request processed in 35us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784689.462092:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787784689.462103:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787784689.462109:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643163904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784689.462140:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643163904:12345-0@lo:400:kworker.0 Request processed in 31us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784689.462146:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787784689.462181:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189161680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643163904:0@lo:400:kworker.0 00000100:00100000:1.0:1787784689.462285:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643163776 00000100:00100000:1.0:1787784689.462289:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643163776 00000100:00100000:1.0:1787784689.462316:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787784689.462322:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431a559e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+19:3295:x1874627643163776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784689.462358:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431a559e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+19:3295:x1874627643163776:12345-0@lo:400:kworker.0 Request processed in 36us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784689.462378:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787784689.462418:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431891612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643164160:0@lo:400:kworker.0 00000100:00100000:1.0:1787784689.462428:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643164032:0@lo:400:kworker.0 00000100:00100000:3.0:1787784689.462564:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787784689.462574:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643164544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784689.462607:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784689.462638:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643164544 00000100:00100000:3.0:1787784689.462641:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643164544 00000100:00100000:3.0:1787784689.462670:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787784689.462677:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643164544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784689.462710:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784689.462754:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643164544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784689.463098:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787784689.463143:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643164544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784689.463185:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189161a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643163776:0@lo:400:kworker.0 00000100:00080000:0.0:1787784689.463261:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787784689.463267:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1787784689.465718:0:14451:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787784689.465738:0:14451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787784689.465856:0:14451:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787784689.465865:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1787784689.589883:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0F:1787784690.623579:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934616 is committed 00000001:00080000:2.0:1787784690.623598:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:2.0:1787784690.623612:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94318851a180 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:2.0:1787784690.623617:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94318574ed00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94318851af00 00000020:00080000:2.0:1787784690.623621:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94318574e100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94308357d400 00000020:00080000:2.0:1787784690.623649:0:14455:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000020:00080000:2.0:1787784690.623856:0:14455:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1787784690.626503:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784691.645880:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784692.436308:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784692.436784:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634790272 00000100:00100000:0.0:1787784692.436796:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634790272 00000100:00100000:3.0:1787784692.436986:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 54 00000100:00100000:3.0:1787784692.436999:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+12:14461:x1874627634790272:12345-192.168.202.59@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787784692.437121:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+12:14461:x1874627634790272:12345-192.168.202.59@tcp:60:lhsmtool_posix.0 Request processed in 126us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784692.437128:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 54 00000100:00080000:0.0:1787784692.437474:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784692.443663:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784692.443760:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634790528 00000100:00100000:3.0:1787784692.443769:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634790528 00000100:00100000:3.0:1787784692.443830:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:3.0:1787784692.443841:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d25a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+12:14461:x1874627634790528:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787784692.444652:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d25a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+13:14461:x1874627634790528:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 809us (995us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1787784692.444663:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00010000:00010000:0.0:1787784692.660738:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784692.989327:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784692.989689:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634790656 00000100:00100000:0.0:1787784692.989700:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634790656 00000100:00100000:0.0:1787784692.989756:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 125 00000100:00100000:0.0:1787784692.989767:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431a559e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:2362:x1874627634790656:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784692.989852:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431a559e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:2362:x1874627634790656:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 86us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784692.989860:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 125 00000100:00100000:2.0:1787784692.990221:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784692.990263:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784692.990285:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784692.990303:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784692.990322:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784692.990346:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634790784 00000100:00100000:2.0:1787784692.990350:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634790784 00000100:00100000:2.0:1787784692.990409:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634790912 00000100:00100000:2.0:1787784692.990424:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634790912 00000100:00080000:1.0:1787784692.990860:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787784692.990866:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784692.990907:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634791168 00000100:00100000:2.0:1787784692.990911:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634791168 00000100:00100000:2.0:1787784692.990942:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634791296 00000100:00100000:2.0:1787784692.990945:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634791296 00000100:00100000:2.0:1787784692.990963:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 26 00000100:00100000:2.0:1787784692.990969:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d26580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+5:2362:x1874627634790784:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784692.991017:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d26580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+5:2362:x1874627634790784:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 47us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784692.991039:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 26 00000100:00100000:2.0:1787784692.991054:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:2.0:1787784692.991061:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197015680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+5:2361:x1874627634790912:12345-192.168.202.59@tcp:9:kworker.0 00000020:00000080:2.0:1787784692.991080:0:15101:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bbd69 00000100:00080000:2.0:1787784692.991094:0:15101:0:(import.c:65:import_set_state_nolock()) ffff9431bea57800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787784692.991131:0:15101:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1787784692.991352:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197015680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+2:2361:x1874627634790912:12345-192.168.202.59@tcp:9:kworker.0 Request processed in 291us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784692.991359:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:2.0:1787784692.991400:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:2.0:1787784692.991407:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba79a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+5:2361:x1874627634791168:12345-192.168.202.59@tcp:9:kworker.0 00000020:00000080:2.0:1787784692.991418:0:15101:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bbda1 00000100:00080000:2.0:1787784692.991423:0:15101:0:(import.c:65:import_set_state_nolock()) ffff9431b3c6a000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787784692.991677:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:3.0:1787784692.991687:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197016d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+5:2361:x1874627634791296:12345-192.168.202.59@tcp:9:kworker.0 00000020:00000080:3.0:1787784692.991707:0:15099:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bbda8 00000100:00080000:3.0:1787784692.991712:0:15099:0:(import.c:65:import_set_state_nolock()) ffff9431962b8800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787784692.991733:0:15099:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1787784692.991834:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197016d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+2:2361:x1874627634791296:12345-192.168.202.59@tcp:9:kworker.0 Request processed in 149us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784692.991842:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 21 00010000:00010000:3.0:1787784692.992082:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784692.992088:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787784692.992552:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787784692.992557:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784692.992667:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634791040 00000100:00100000:0.0:1787784692.992688:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634791040 00000100:00100000:0.0:1787784692.992752:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 35 00000100:00100000:0.0:1787784692.992759:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d25e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:2362:x1874627634791040:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784692.992811:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d25e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:2362:x1874627634791040:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 53us (3373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784692.992817:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 35 00000001:00000004:2.0:1787784692.994695:0:15101:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:2.0:1787784692.995015:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba79a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+2:2361:x1874627634791168:12345-192.168.202.59@tcp:9:kworker.0 Request processed in 3602us (4703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784692.995027:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00080000:1.0:1787784692.995779:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784693.044824:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643164672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784693.044919:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784693.045040:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643164672 00000100:00100000:0.0:1787784693.045049:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643164672 00000100:00100000:0.0:1787784693.045118:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787784693.045128:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643164672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787784693.045165:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 68091904 pending 0 free 3851419648 avail 3849322496 00000100:00080000:2.0:1787784693.045542:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784693.049721:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643164672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4582us (4789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784693.049740:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787784693.063227:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643164672:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787784693.684755:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784694.582542:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643164800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784694.582650:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784694.582830:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643164800 00000100:00100000:0.0:1787784694.582841:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643164800 00000100:00100000:0.0:1787784694.582941:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787784694.582951:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431891612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643164800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784694.582990:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787784694.583050:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431891612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643164800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784694.583065:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787784694.583484:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643164800:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787784694.583520:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784694.584396:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784694.584606:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874627643165184:0@lo:400:kworker.0 00000100:00100000:2.0:1787784694.584664:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784694.584712:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787784694.584719:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643165056:0@lo:400:kworker.0 00000100:00100000:2.0:1787784694.584745:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784694.584787:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643165184 00000100:00100000:2.0:1787784694.584811:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643165184 00000100:00100000:2.0:1787784694.584866:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787784694.584874:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197015680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874627643165184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784694.584935:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197015680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874627643165184:12345-0@lo:400:kworker.0 Request processed in 61us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784694.584942:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787784694.584979:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874627643165184:0@lo:400:kworker.0 00000100:00100000:2.0:1787784694.585012:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643165056 00000100:00100000:2.0:1787784694.585016:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643165056 00000100:00100000:2.0:1787784694.585065:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787784694.585072:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431970161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643165056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784694.585105:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431970161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643165056:12345-0@lo:400:kworker.0 Request processed in 34us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784694.585111:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787784694.585136:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643165056:0@lo:400:kworker.0 00000100:00100000:1.0:1787784694.585986:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643165312:0@lo:400:kworker.0 00000100:00100000:1.0:1787784694.586134:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784694.586396:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643164928:0@lo:400:kworker.0 00000100:00100000:1.0:1787784694.586439:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784694.586789:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643164928 00000100:00100000:2.0:1787784694.586795:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643164928 00000100:00100000:2.0:1787784694.586840:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787784694.586849:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431a559c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+19:3295:x1874627643164928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784694.586906:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431a559c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+19:3295:x1874627643164928:12345-0@lo:400:kworker.0 Request processed in 58us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784694.586913:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787784694.587392:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643165440:0@lo:400:kworker.0 00000100:00100000:2.0:1787784694.587422:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784694.587499:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643164928:0@lo:400:kworker.0 00000100:00100000:0.0:1787784694.589445:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643165312 00000100:00100000:0.0:1787784694.589461:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643165312 00000100:00100000:0.0:1787784694.589541:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643165440 00000100:00100000:0.0:1787784694.589545:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643165440 00000100:00100000:0.0:1787784694.589570:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787784694.589578:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643165312:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787784694.589688:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784694.589841:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787784694.589852:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431970152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643165440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784694.589949:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431970152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643165440:12345-0@lo:400:kworker.0 Request processed in 99us (2525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784694.589956:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787784694.590170:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643165440:0@lo:400:kworker.0 00000100:00100000:0.0:1787784694.591795:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643165312:12345-0@lo:400:kworker.0 Request processed in 2214us (5657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784694.591804:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787784694.592868:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643165312:0@lo:400:kworker.0 00010000:00010000:3.0:1787784694.708828:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787784695.156576:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c50cf92d-6067-4c10-bfbc-11c55aeaf749 00000020:00000080:3.0:1787784695.156586:0:7631:0:(genops.c:885:class_export_put()) final put ffff9431bea52800/c50cf92d-6067-4c10-bfbc-11c55aeaf749 00000001:00100000:3.0:1787784695.156616:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e94ca4a8-f17e-4bfb-939c-0ba59f45e136 00000020:00000080:3.0:1787784695.156619:0:7631:0:(genops.c:885:class_export_put()) final put ffff9431962b8000/e94ca4a8-f17e-4bfb-939c-0ba59f45e136 00000020:00000080:1.0:1787784695.156978:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bea52800/c50cf92d-6067-4c10-bfbc-11c55aeaf749 for lustre-OST0001 00000020:00000080:1.0:1787784695.157028:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431962b8000/e94ca4a8-f17e-4bfb-939c-0ba59f45e136 for lustre-OST0001 00000020:00000080:1.0:1787784695.157042:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431bea57800 for lustre-OST0001 00000020:00000080:1.0:1787784695.157057:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431962b8800 for lustre-OST0001 00000020:00080000:1.0:1787784695.706634:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967527 batchid updated 00000001:00080000:1.0:1787784695.706665:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1787784695.707112:0:14455:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000020:00080000:2.0:1787784695.707122:0:14455:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00010000:00010000:3.0:1787784695.734410:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787784696.156435:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e94ca4a8-f17e-4bfb-939c-0ba59f45e136 00000020:00000080:2.0:1787784696.156445:0:6703:0:(genops.c:885:class_export_put()) final put ffff9431b3c68000/e94ca4a8-f17e-4bfb-939c-0ba59f45e136 00000020:00000080:2.0:1787784696.156475:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b3c68000/e94ca4a8-f17e-4bfb-939c-0ba59f45e136 for lustre-OST0000 00000020:00000080:2.0:1787784696.156529:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431b3c6a000 for lustre-OST0000 00010000:00010000:2.0:1787784696.766535:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784697.780796:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784698.105466:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784698.105511:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784698.105565:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784698.105592:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784698.105599:0:16700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634791680 00000100:00100000:1.0:1787784698.105612:0:16700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634791680 00000100:00100000:3.0:1787784698.105625:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634791552 00000100:00100000:3.0:1787784698.105631:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634791552 00000100:00100000:3.0:1787784698.105685:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634791808 00000100:00100000:1.0:1787784698.105690:0:16700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 28 00000100:00100000:3.0:1787784698.105691:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634791808 00000100:00100000:1.0:1787784698.105705:0:16700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+5:2363:x1874627634791680:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784698.105723:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 39 00000100:00100000:3.0:1787784698.105732:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+12:2363:x1874627634791552:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784698.105821:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 40 00000100:00100000:0.0:1787784698.105824:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634791424 00000100:00100000:0.0:1787784698.105830:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634791424 00000100:00100000:2.0:1787784698.105834:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:2363:x1874627634791808:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784698.105903:0:16700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+5:2363:x1874627634791680:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 202us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784698.105912:0:16700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 28 00000100:00080000:1.0:1787784698.105936:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784698.105938:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 127 00000100:00080000:1.0:1787784698.105943:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784698.105951:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431a559d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:2363:x1874627634791424:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784698.107758:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+12:2363:x1874627634791552:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 2017us (2182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784698.107771:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 39 00000100:00100000:0.0:1787784698.108344:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431a559d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:2363:x1874627634791424:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 2393us (2893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784698.108354:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 127 00000100:00100000:2.0:1787784698.109847:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:2363:x1874627634791808:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 4005us (4242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784698.109863:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 40 00000100:00100000:2.0:1787784698.165691:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643165568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784698.165782:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784698.165902:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643165568 00000100:00100000:3.0:1787784698.165912:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643165568 00000100:00100000:3.0:1787784698.165990:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787784698.166001:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197014780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643165568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784698.166060:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 68091904 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1787784698.175341:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197014780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643165568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9329us (9547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784698.175360:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1787784698.175429:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784698.179617:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643165568:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787784698.805576:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787784699.701839:0:14451:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787784699.701850:0:14451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787784699.701916:0:14451:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787784699.701925:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787784699.702530:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189161e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643165696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784699.702601:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784699.702803:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643165696 00000100:00100000:1.0:1787784699.702811:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643165696 00000100:00100000:1.0:1787784699.702875:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787784699.702886:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197017840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643165696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784699.702926:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784699.702991:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197017840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643165696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784699.703000:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787784699.703045:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189161e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643165696:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787784699.703440:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784699.710840:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643165952:0@lo:400:kworker.0 00000100:00100000:0.0:1787784699.710914:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784699.710957:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787784699.710963:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:459db144-24ce-4979-944c-65e392f5ff2a:3296:1874627643165824:0@lo:400:kworker.0 00000100:00100000:0.0:1787784699.710991:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784699.711017:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643166336:0@lo:400:kworker.0 00000100:00100000:0.0:1787784699.711039:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784699.711070:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643165952 00000100:00100000:0.0:1787784699.711077:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643165952 00000100:00100000:0.0:1787784699.711123:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787784699.711133:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643165952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784699.711188:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643165952:12345-0@lo:400:kworker.0 Request processed in 56us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784699.711212:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787784699.711237:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643165824 00000100:00100000:0.0:1787784699.711241:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643165824 00000100:00100000:0.0:1787784699.711265:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787784699.711271:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2980c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+19:3296:x1874627643165824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784699.711302:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2980c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+19:3296:x1874627643165824:12345-0@lo:400:kworker.0 Request processed in 32us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784699.711308:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787784699.711333:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643166336 00000100:00100000:0.0:1787784699.711337:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643166336 00000100:00100000:0.0:1787784699.711389:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787784699.711396:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643166336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784699.711424:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643166336:12345-0@lo:400:kworker.0 Request processed in 30us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784699.711431:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787784699.711473:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:459db144-24ce-4979-944c-65e392f5ff2a:3296:1874627643165824:0@lo:400:kworker.0 00000100:00100000:0.0:1787784699.711486:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643166336:0@lo:400:kworker.0 00000100:00100000:0.0:1787784699.711495:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643165952:0@lo:400:kworker.0 00000100:00080000:0.0:1787784699.711519:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784699.711532:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643166080:0@lo:400:kworker.0 00000100:00100000:0.0:1787784699.711554:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784699.711572:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784699.711578:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643166208:0@lo:400:kworker.0 00000100:00100000:0.0:1787784699.711596:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784699.711626:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643166080 00000100:00100000:0.0:1787784699.711630:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643166080 00000100:00100000:0.0:1787784699.711648:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643166208 00000100:00100000:0.0:1787784699.711651:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643166208 00000100:00100000:0.0:1787784699.711668:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787784699.711674:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643166080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784699.711705:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643166080:12345-0@lo:400:kworker.0 Request processed in 31us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784699.711711:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787784699.711722:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787784699.711728:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643166208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784699.711750:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643166208:12345-0@lo:400:kworker.0 Request processed in 23us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784699.711756:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1787784699.711772:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784699.711786:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643166208:0@lo:400:kworker.0 00000100:00100000:0.0:1787784699.711795:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643166080:0@lo:400:kworker.0 00010000:00010000:3.0:1787784699.829816:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784700.858684:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784701.878260:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784702.902066:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784703.227920:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784703.228081:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634791936 00000100:00100000:3.0:1787784703.228095:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634791936 00000100:00100000:3.0:1787784703.228175:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 129 00000100:00100000:3.0:1787784703.228189:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2981850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:2363:x1874627634791936:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784703.228304:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2981850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:2363:x1874627634791936:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 117us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784703.228313:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 129 00000100:00100000:0.0:1787784703.228631:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784703.229224:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784703.229285:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784703.229315:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634792064 00000100:00100000:0.0:1787784703.229322:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634792064 00000100:00100000:0.0:1787784703.229395:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634792320 00000100:00100000:0.0:1787784703.229399:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634792320 00000100:00100000:0.0:1787784703.229422:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 44 00000100:00100000:0.0:1787784703.229446:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+12:2363:x1874627634792064:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784703.229529:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+12:2363:x1874627634792064:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 85us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784703.229537:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 44 00000100:00100000:0.0:1787784703.229553:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00100000:0.0:1787784703.229559:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:2363:x1874627634792320:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784703.229582:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:2363:x1874627634792320:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 23us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784703.229588:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00080000:0.0:1787784703.229717:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784703.238112:0:16700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634792192 00000100:00100000:3.0:1787784703.238135:0:16700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634792192 00000100:00100000:3.0:1787784703.238325:0:16700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00100000:3.0:1787784703.238339:0:16700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+5:2363:x1874627634792192:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784703.238505:0:16700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+5:2363:x1874627634792192:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 169us (10529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784703.238514:0:16700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00080000:0.0:1787784703.240395:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784703.284881:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189161a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643166464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784703.285006:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784703.285243:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643166464 00000100:00100000:1.0:1787784703.285256:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643166464 00000100:00100000:1.0:1787784703.285341:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787784703.285353:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643166464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784703.285444:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 68091904 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1787784703.285509:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643166464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784703.285517:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787784703.285580:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189161a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643166464:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787784703.285672:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787784703.928534:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787784704.436276:0:17360:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 18:51:43 (1787784703) 00000100:00100000:3.0:1787784704.821009:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643166976:0@lo:400:kworker.0 00000100:00100000:3.0:1787784704.821123:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784704.821207:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784704.821214:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643166848:0@lo:400:kworker.0 00000100:00100000:3.0:1787784704.821244:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784704.821517:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:459db144-24ce-4979-944c-65e392f5ff2a:3293:1874627643166592:0@lo:400:kworker.0 00000100:00100000:0.0:1787784704.821562:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784704.821599:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643167104:0@lo:400:kworker.0 00000100:00100000:0.0:1787784704.821625:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784704.821645:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787784704.821651:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643166720:0@lo:400:kworker.0 00000100:00100000:0.0:1787784704.821676:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784704.821693:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643167232:0@lo:400:kworker.0 00000100:00100000:0.0:1787784704.821715:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784704.821750:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643166976 00000100:00100000:0.0:1787784704.821759:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643166976 00000100:00100000:0.0:1787784704.821817:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643167104 00000100:00100000:0.0:1787784704.821840:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643167104 00000100:00100000:0.0:1787784704.821867:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643167232 00000100:00100000:0.0:1787784704.821871:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643167232 00000100:00100000:0.0:1787784704.821905:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787784704.821916:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643166976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784704.821988:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643166976:12345-0@lo:400:kworker.0 Request processed in 73us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784704.821996:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787784704.822015:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787784704.822021:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b41983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643167104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784704.822052:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b41983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643167104:12345-0@lo:400:kworker.0 Request processed in 31us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784704.822059:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787784704.822069:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787784704.822074:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b4198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643167232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784704.822099:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b4198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643167232:12345-0@lo:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784704.822104:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787784704.822124:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643166848 00000100:00100000:0.0:1787784704.822127:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643166848 00000100:00100000:0.0:1787784704.822156:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643166720 00000100:00100000:0.0:1787784704.822160:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643166720 00000100:00100000:0.0:1787784704.822181:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787784704.822188:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643166848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784704.822219:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643166848:12345-0@lo:400:kworker.0 Request processed in 32us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784704.822227:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787784704.822247:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787784704.822253:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b419b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643166720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784704.822281:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b419b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643166720:12345-0@lo:400:kworker.0 Request processed in 28us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784704.822286:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1787784704.822321:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787784704.822327:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784704.822420:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643166720:0@lo:400:kworker.0 00000100:00100000:0.0:1787784704.822435:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643167232:0@lo:400:kworker.0 00000100:00100000:0.0:1787784704.822445:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643167104:0@lo:400:kworker.0 00000100:00100000:0.0:1787784704.822490:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643166848:0@lo:400:kworker.0 00000100:00100000:0.0:1787784704.822502:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643166976:0@lo:400:kworker.0 00000100:00100000:3.0:1787784704.824361:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643166592 00000100:00100000:3.0:1787784704.824409:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643166592 00000100:00100000:3.0:1787784704.824510:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787784704.824519:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2983850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+19:3293:x1874627643166592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784704.824635:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2983850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+19:3293:x1874627643166592:12345-0@lo:400:kworker.0 Request processed in 117us (3072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784704.824643:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787784704.825112:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:459db144-24ce-4979-944c-65e392f5ff2a:3293:1874627643166592:0@lo:400:kworker.0 00000100:00100000:1.0:1787784704.825239:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787784704.825259:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643167360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784704.825314:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784704.825407:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643167360 00000100:00100000:0.0:1787784704.825423:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643167360 00000100:00100000:0.0:1787784704.825471:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787784704.825479:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189161680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643167360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784704.825521:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787784704.825577:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189161680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643167360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784704.825584:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787784704.825900:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643167360:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787784704.949651:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784705.974118:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784706.996653:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784708.020691:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784708.351974:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784708.352033:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784708.352075:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784708.352129:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784708.352181:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634792576 00000100:00100000:2.0:1787784708.352196:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634792832 00000100:00100000:0.0:1787784708.352196:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634792576 00000100:00100000:2.0:1787784708.352216:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634792832 00000100:00100000:3.0:1787784708.352238:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634792704 00000100:00100000:3.0:1787784708.352248:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634792704 00000100:00100000:0.0:1787784708.352290:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00100000:3.0:1787784708.352299:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:0.0:1787784708.352306:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+12:2363:x1874627634792576:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784708.352313:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+5:2361:x1874627634792704:12345-192.168.202.59@tcp:9:kworker.0 00000020:00000080:3.0:1787784708.352436:0:15099:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bbd70 00000100:00080000:3.0:1787784708.352449:0:15099:0:(import.c:65:import_set_state_nolock()) ffff9431bea51800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787784708.352500:0:15099:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:0.0:1787784708.352633:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+12:2363:x1874627634792576:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 333us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784708.352642:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00080000:0.0:1787784708.352667:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787784708.352672:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787784708.352709:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784708.352824:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+2:2361:x1874627634792704:12345-192.168.202.59@tcp:9:kworker.0 Request processed in 515us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784708.352831:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:1.0:1787784708.353275:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634792448 00000100:00100000:1.0:1787784708.353282:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634792448 00000100:00100000:1.0:1787784708.353332:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 131 00000100:00100000:1.0:1787784708.353342:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2980450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:2363:x1874627634792448:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784708.353419:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2980450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:2363:x1874627634792448:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 78us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784708.353426:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 131 00000100:00100000:2.0:1787784708.353458:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 50 00000100:00100000:2.0:1787784708.353474:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:2362:x1874627634792832:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784708.353547:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:2362:x1874627634792832:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 79us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784708.353555:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 50 00000100:00100000:2.0:1787784708.406520:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643167488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784708.406624:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784708.406758:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643167488 00000100:00100000:0.0:1787784708.406769:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643167488 00000100:00080000:3.0:1787784708.406835:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784708.406853:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787784708.406863:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197015a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643167488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787784708.406909:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1787784708.411878:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197015a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643167488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4998us (5236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784708.411902:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787784708.412757:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643167488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784708.695190:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784708.695423:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634793088 00000100:00100000:0.0:1787784708.695704:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634793088 00000100:00100000:0.0:1787784708.695783:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:0.0:1787784708.695796:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197014f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+12:15344:x1874627634793088:12345-192.168.202.59@tcp:35:umount.0 00000001:00080000:0.0:1787784708.697221:0:14419:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1787784708.698114:0:14419:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:0.0:1787784708.699766:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197014f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+15:15344:x1874627634793088:12345-192.168.202.59@tcp:35:umount.0 Request processed in 3956us (4576us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1787784708.699807:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00000020:00080000:0.0:1787784708.699819:0:14419:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787784708.716840:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784708.716894:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784708.717103:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634793216 00000100:00100000:0.0:1787784708.717113:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634793216 00000100:00100000:0.0:1787784708.717179:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634793344 00000100:00100000:0.0:1787784708.717182:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634793344 00000100:00100000:0.0:1787784708.717207:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 3 00000100:00100000:0.0:1787784708.717216:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189162d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:694b64e1-3991-40c4-9fdb-8a8fe572759c+14:2364:x1874627634793216:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784708.717232:0:14401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784708.717249:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94308269fa00/0xffb8d925c20bbd4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad3a expref: 14 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784708.717267:0:14401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784708.717312:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189162d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:2364:x1874627634793216:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 98us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784708.717320:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 3 00000100:00100000:0.0:1787784708.717334:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:0.0:1787784708.717340:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189163c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:694b64e1-3991-40c4-9fdb-8a8fe572759c+12:2364:x1874627634793344:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784708.717557:0:14401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784708.717567:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bee89a00/0xffb8d925c20bbd54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad64 expref: 12 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784708.717579:0:14401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784708.717596:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189163c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:694b64e1-3991-40c4-9fdb-8a8fe572759c+11:2364:x1874627634793344:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 256us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784708.717602:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:2.0:1787784708.732026:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784708.732189:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634793472 00000100:00100000:3.0:1787784708.732207:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634793472 00000100:00100000:3.0:1787784708.732312:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:3.0:1787784708.732326:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b299d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:694b64e1-3991-40c4-9fdb-8a8fe572759c+11:2363:x1874627634793472:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784708.732351:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784708.732420:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf500e00/0xffb8d925c20bbdf5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae05 expref: 11 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784708.732445:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784708.732519:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b299d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:694b64e1-3991-40c4-9fdb-8a8fe572759c+10:2363:x1874627634793472:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 196us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784708.732551:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:2.0:1787784708.735326:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784708.735515:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634794368 00000100:00100000:0.0:1787784708.735528:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634794368 00000100:00100000:0.0:1787784708.735610:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 55 00000100:00100000:0.0:1787784708.735621:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+15:2361:x1874627634794368:12345-192.168.202.59@tcp:39:umount.0 00000020:00000080:0.0:1787784708.735677:0:14416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bbd62 00000020:00010000:0.0:1787784708.735697:0:14416:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9431bee31800: total 0 00000100:00080000:0.0:1787784708.735704:0:14416:0:(import.c:65:import_set_state_nolock()) ffff9431884d9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787784708.735747:0:14416:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:0.0:1787784708.736564:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+14:2361:x1874627634794368:12345-192.168.202.59@tcp:39:umount.0 Request processed in 938us (1247us total) trans 8589934627 rc 0/0 00000100:00100000:0.0:1787784708.736576:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 55 00000020:00010000:1.0:1787784708.736735:0:14404:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9431bee31800: total 0 00010000:00010000:1.0:1787784708.736742:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784708.736798:0:14404:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9431bee31800, canceled 0 locks, left on hash table 7. 00010000:00010000:1.0:1787784708.736844:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff943187f1d500) 00010000:00010000:1.0:1787784708.736848:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787784708.736859:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bbe11 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae0c expref: 13 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784708.736888:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff943187f1de00) 00010000:00010000:1.0:1787784708.736892:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787784708.736896:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bbeea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae4b expref: 12 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784708.736941:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff943190486400) 00010000:00010000:1.0:1787784708.736944:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787784708.736948:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943181512800/0xffb8d925c20bbfe6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae98 expref: 11 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784708.736966:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff943187f1da00) 00010000:00010000:1.0:1787784708.736968:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787784708.736973:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bbf68 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae75 expref: 10 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784708.736985:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff943187f1da00) 00010000:00010000:1.0:1787784708.736988:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787784708.736991:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94308269e400/0xffb8d925c20bbf8b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae83 expref: 9 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784708.737036:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff943187f1d000) 00010000:00010000:1.0:1787784708.737039:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784708.737044:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bbe2d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae13 expref: 8 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784708.737061:0:14404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943190486c00) 00010000:00010000:1.0:1787784708.737063:0:14404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787784708.737067:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943181513e00/0xffb8d925c20bbe65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae21 expref: 7 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784708.737079:0:14404:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9431bee31800, canceled 7 locks, left on hash table 0. 00010000:00010000:1.0:1787784708.737093:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784708.737095:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784708.737097:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784709.044755:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787784709.942736:0:14451:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787784709.942750:0:14451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787784709.942821:0:14451:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787784709.942829:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787784709.945268:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787784709.945301:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643167616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784709.945439:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784709.945728:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643168128:0@lo:400:kworker.0 00000100:00100000:2.0:1787784709.945743:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431970143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643168000:0@lo:400:kworker.0 00000100:00100000:1.0:1787784709.945777:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784709.945807:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643168128 00000100:00100000:1.0:1787784709.945816:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787784709.945824:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197014b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:459db144-24ce-4979-944c-65e392f5ff2a:3293:1874627643167744:0@lo:400:kworker.0 00000100:00100000:1.0:1787784709.945860:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784709.945885:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643168256:0@lo:400:kworker.0 00000100:00100000:1.0:1787784709.945910:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784709.945945:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643167744 00000100:00100000:1.0:1787784709.945950:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643167744 00000100:00100000:3.0:1787784709.946016:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197016940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643167872:0@lo:400:kworker.0 00000100:00100000:1.0:1787784709.946020:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787784709.946033:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2982850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+19:3293:x1874627643167744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784709.946055:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784709.946100:0:16700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643167872 00000100:00100000:1.0:1787784709.946103:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2982850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+19:3293:x1874627643167744:12345-0@lo:400:kworker.0 Request processed in 72us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784709.946105:0:16700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643167872 00000100:00100000:1.0:1787784709.946127:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787784709.946149:0:16700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787784709.946159:0:16700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643167872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784709.946163:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643168256 00000100:00100000:1.0:1787784709.946167:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643168256 00000100:00100000:1.0:1787784709.946208:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787784709.946213:0:16700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643167872:12345-0@lo:400:kworker.0 Request processed in 54us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784709.946218:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189161e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643168256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784709.946228:0:16700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787784709.946249:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189161e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643168256:12345-0@lo:400:kworker.0 Request processed in 34us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784709.946254:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1787784709.946259:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784709.946291:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197014b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:459db144-24ce-4979-944c-65e392f5ff2a:3293:1874627643167744:0@lo:400:kworker.0 00000100:00100000:3.0:1787784709.946296:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197016940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643167872:0@lo:400:kworker.0 00000100:00100000:1.0:1787784709.946305:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643168256:0@lo:400:kworker.0 00000100:00100000:1.0:1787784709.946330:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784709.946362:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643168000 00000100:00100000:3.0:1787784709.946406:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643168000 00000100:00100000:3.0:1787784709.946436:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787784709.946443:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189162580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643168000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784709.946481:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189162580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643168000:12345-0@lo:400:kworker.0 Request processed in 38us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784709.946488:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787784709.946554:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431970143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643168000:0@lo:400:kworker.0 00000100:00100000:2.0:1787784709.946648:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643168128 00000100:00100000:2.0:1787784709.946686:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787784709.946691:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189161a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643168128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784709.946702:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643167616 00000100:00100000:0.0:1787784709.946709:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643167616 00000100:00100000:2.0:1787784709.946724:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189161a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643168128:12345-0@lo:400:kworker.0 Request processed in 32us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784709.946738:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787784709.946756:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787784709.946767:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643167616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784709.946804:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787784709.946852:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787784709.946856:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784709.946867:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643167616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784709.946875:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787784709.946917:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643168128:0@lo:400:kworker.0 00000100:00100000:2.0:1787784709.948697:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643167616:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787784710.068672:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784711.029062:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784711.030774:0:16535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634794496 00000100:00100000:3.0:1787784711.030790:0:16535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634794496 00000100:00100000:3.0:1787784711.030974:0:16535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:3.0:1787784711.030984:0:16535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189160000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:694b64e1-3991-40c4-9fdb-8a8fe572759c+10:2365:x1874627634794496:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784711.031000:0:16535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784711.031022:0:16535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bee88600/0xffb8d925c20bbd85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad9c expref: 10 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784711.031041:0:16535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784711.031103:0:16535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189160000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:694b64e1-3991-40c4-9fdb-8a8fe572759c+9:2365:x1874627634794496:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 120us (2055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784711.031111:0:16535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:1.0:1787784711.033618:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784711.033848:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634794752 00000100:00100000:0.0:1787784711.033859:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634794752 00000100:00100000:0.0:1787784711.033922:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:0.0:1787784711.033932:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189163840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:694b64e1-3991-40c4-9fdb-8a8fe572759c+9:2362:x1874627634794752:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784711.033947:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784711.033984:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf500800/0xffb8d925c20bbdee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849adfe expref: 9 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784711.034001:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784711.034056:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189163840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:694b64e1-3991-40c4-9fdb-8a8fe572759c+8:2362:x1874627634794752:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 125us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784711.034064:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:1.0:1787784711.034259:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784711.034648:0:16535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634794624 00000100:00100000:1.0:1787784711.034653:0:16535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634794624 00000100:00100000:1.0:1787784711.034687:0:16535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:1.0:1787784711.034694:0:16535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189160780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:694b64e1-3991-40c4-9fdb-8a8fe572759c+8:2362:x1874627634794624:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784711.034705:0:16535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784711.034717:0:16535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bee89e00/0xffb8d925c20bbd8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849adc6 expref: 8 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784711.034731:0:16535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784711.035552:0:16535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189160780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:694b64e1-3991-40c4-9fdb-8a8fe572759c+7:2362:x1874627634794624:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 853us (1288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784711.035561:0:16535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:2.0:1787784711.045541:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784711.045943:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634795008 00000100:00100000:3.0:1787784711.045955:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634795008 00000100:00100000:3.0:1787784711.046034:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 56 00000100:00100000:3.0:1787784711.046047:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:2361:x1874627634795008:12345-192.168.202.59@tcp:39:umount.0 00000020:00000080:3.0:1787784711.046093:0:14415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bbd9a 00000020:00010000:3.0:1787784711.046103:0:14415:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9431bea50000: total 0 00000100:00080000:3.0:1787784711.046109:0:14415:0:(import.c:65:import_set_state_nolock()) ffff9431bea56000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787784711.046138:0:14415:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00080000:2.0:1787784711.047191:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784711.047255:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+5:2361:x1874627634795008:12345-192.168.202.59@tcp:39:umount.0 Request processed in 1208us (1722us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1787784711.047266:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 56 00000020:00010000:3.0:1787784711.047327:0:14405:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9431bea50000: total 0 00010000:00010000:3.0:1787784711.047412:0:14405:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9431bea50000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787784711.047454:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943190486c00) 00010000:00010000:3.0:1787784711.047458:0:14405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787784711.047467:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ee00/0xffb8d925c20bbe73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae28 expref: 4 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784711.047506:0:14405:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9431bea50000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787784711.048469:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784711.048475:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784711.048478:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787784711.048615:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c50cf92d-6067-4c10-bfbc-11c55aeaf749 00000001:00080000:0.0:1787784711.048631:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:0.0:1787784711.048642:0:5853:0:(genops.c:885:class_export_put()) final put ffff9431bee31800/c50cf92d-6067-4c10-bfbc-11c55aeaf749 00000020:00000080:2.0:1787784711.049788:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bee31800/c50cf92d-6067-4c10-bfbc-11c55aeaf749 for lustre-MDT0000 00000020:00000080:2.0:1787784711.049868:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431884d9800 for lustre-MDT0000 00000100:00100000:0.0:1787784711.070906:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784711.071031:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634795264 00000100:00100000:3.0:1787784711.071044:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634795264 00000100:00100000:3.0:1787784711.071112:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 133 00000100:00100000:3.0:1787784711.071123:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2983c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+7:2361:x1874627634795264:12345-192.168.202.59@tcp:251:umount.0 00000020:00000080:3.0:1787784711.071173:0:14408:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bbd3f 00000020:00010000:3.0:1787784711.071182:0:14408:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9431bee35000: total 0 00000100:00080000:3.0:1787784711.071187:0:14408:0:(import.c:65:import_set_state_nolock()) ffff9431bee32800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787784711.071270:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2983c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+3:2361:x1874627634795264:12345-192.168.202.59@tcp:251:umount.0 Request processed in 149us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784711.071279:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 133 00000020:00010000:0.0:1787784711.071595:0:14404:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9431bee35000: total 0 00010000:00010000:0.0:1787784711.071600:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784711.072122:0:14404:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9431bee35000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787784711.072166:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94308269e200/0xffb8d925c20bbd46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad33 expref: 2 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784711.072184:0:14404:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9431bee35000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787784711.072193:0:14404:0:(genops.c:885:class_export_put()) final put ffff9431bee35000/694b64e1-3991-40c4-9fdb-8a8fe572759c 00010000:00010000:0.0:1787784711.072214:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784711.072216:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784711.072217:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787784711.072274:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bee35000/694b64e1-3991-40c4-9fdb-8a8fe572759c for MGS 00000020:00000080:1.0:1787784711.072318:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431bee32800 for MGS 00010000:00010000:3.0:1787784711.096293:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787784711.543697:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c50cf92d-6067-4c10-bfbc-11c55aeaf749 00000020:00000080:3.0:1787784711.543705:0:6703:0:(genops.c:885:class_export_put()) final put ffff9431bea51000/c50cf92d-6067-4c10-bfbc-11c55aeaf749 00000020:00000080:3.0:1787784711.543732:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bea51000/c50cf92d-6067-4c10-bfbc-11c55aeaf749 for lustre-OST0000 00000020:00000080:3.0:1787784711.543783:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431bea51800 for lustre-OST0000 00010000:00010000:3.0:1787784712.116710:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787784712.960167:0:17559:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787784712.974794:0:17559:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787784712.974848:0:17559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf501800/0xffb8d925c20bba6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bba75 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784712.974865:0:17559:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf501800/0xffb8d925c20bba6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bba75 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784712.974873:0:17559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf501800/0xffb8d925c20bba6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bba75 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784712.974881:0:17559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff9431bf501800/0xffb8d925c20bba6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bba75 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784712.980681:0:17559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787784712.980696:0:17559:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787784712.980749:0:17559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787784712.980754:0:17559:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787784712.980759:0:17559:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787784712.980785:0:17559:0:(import.c:65:import_set_state_nolock()) ffff9431904c0800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787784712.982209:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874627643168384:0@lo:39:umount.0 00000100:00100000:2.0:1787784712.982441:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784712.982541:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643168384 00000100:00100000:2.0:1787784712.982548:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643168384 00000100:00100000:2.0:1787784712.982662:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787784712.982671:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94318a55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874627643168384:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787784712.982699:0:14417:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bba9f 00000100:00080000:2.0:1787784712.982980:0:14417:0:(import.c:65:import_set_state_nolock()) ffff9431bed65000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787784712.986479:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784712.986494:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431bf501800/0xffb8d925c20bba6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bba75 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.986506:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501800 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:3.0:1787784712.986511:0:14405:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431bf501800/0xffb8d925c20bba6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bba75 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.986537:0:14405:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431bf501800/0xffb8d925c20bba6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20bba75 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784712.986546:0:14405:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431bf501800/0xffb8d925c20bba6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20bba75 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784712.986551:0:14405:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787784712.986554:0:14405:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787784712.986557:0:14405:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787784712.986780:0:14405:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431bf501800/0xffb8d925c20bba6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bba75 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.986788:0:14405:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787784712.986848:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643168512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784712.986939:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787784712.987075:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431bf501800/0xffb8d925c20bba6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bba75 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.987083:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431bf501800/0xffb8d925c20bba6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bba75 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.987099:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784712.987100:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784712.987102:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784712.987328:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94318a55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3292:x1874627643168384:12345-0@lo:39:umount.0 Request processed in 4656us (4884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784712.987348:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000020:00000080:2.0:1787784712.987361:0:14417:0:(genops.c:885:class_export_put()) final put ffff9431b42bf000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787784712.987416:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b42bf000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787784712.987462:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431bed65000 for lustre-MDT0000 00000100:00080000:2.0:1787784712.987510:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431904c0800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787784712.987522:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874627643168384:0@lo:39:umount.0 00000100:00100000:2.0:1787784712.987567:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643168512 00000100:00100000:2.0:1787784712.987572:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643168512 00000100:00100000:2.0:1787784712.987849:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787784712.987857:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189163c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:459db144-24ce-4979-944c-65e392f5ff2a+19:3295:x1874627643168512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784712.987884:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784712.987916:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943185611e00/0xffb8d925c20bba75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20bba6e expref: 19 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784712.987931:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787784712.987998:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787784712.989187:0:17559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787784712.989195:0:17559:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787784712.989201:0:17559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787784712.991355:0:17559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185611400/0xffb8d925c20bb9d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bb9db expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784712.991403:0:17559:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185611400/0xffb8d925c20bb9d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bb9db expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784712.991427:0:17559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185611400/0xffb8d925c20bb9d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bb9db expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784712.991435:0:17559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff943185611400/0xffb8d925c20bb9d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bb9db expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784712.991461:0:17559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787784712.991468:0:17559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bbc66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbc6d expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784712.991476:0:17559:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bbc66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bbc6d expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784712.991483:0:17559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bbc66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bbc6d expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784712.991488:0:17559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bbc66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bbc6d expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784712.991500:0:17559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787784712.991506:0:17559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf500200/0xffb8d925c20bbde0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbde7 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784712.991512:0:17559:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf500200/0xffb8d925c20bbde0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bbde7 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784712.991517:0:17559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf500200/0xffb8d925c20bbde0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bbde7 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784712.991533:0:17559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff9431bf500200/0xffb8d925c20bbde0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bbde7 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784712.991542:0:17559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787784712.991547:0:17559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20bb9c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bb9cd expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784712.991554:0:17559:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20bb9c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bb9cd expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784712.991561:0:17559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20bb9c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bb9cd expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784712.991569:0:17559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20bb9c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bb9cd expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784712.991575:0:17559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1787784712.991578:0:17559:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787784712.991853:0:17559:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787784712.991858:0:17559:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787784712.991861:0:17559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787784712.991867:0:17559:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:0.0:1787784712.991874:0:17559:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9431bee36000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787784712.991880:0:17559:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff943192073000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787784712.991955:0:17559:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9431bea50000 e94ca4a8-f17e-4bfb-939c-0ba59f45e136 192.168.202.59@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1787784712.991962:0:17559:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff943185780000) has exports, disconnecting them 00000020:00080000:0.0:1787784712.991967:0:17559:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9431bee36000), last request at 1787784709 00000020:00000080:0.0:1787784712.991980:0:17559:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bbc58 00000100:00080000:0.0:1787784712.992002:0:17559:0:(import.c:65:import_set_state_nolock()) ffff9431bee34000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787784712.992055:0:17559:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9431bee36000): rc 0 00000020:00000080:0.0:1787784712.992058:0:17559:0:(genops.c:885:class_export_put()) final put ffff9431bee36000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787784712.992079:0:17559:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff943192073000), last request at 1787784709 00000020:00000080:0.0:1787784712.992082:0:17559:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bbb24 00000100:00080000:0.0:1787784712.992087:0:17559:0:(import.c:65:import_set_state_nolock()) ffff943192073800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787784712.992094:0:17559:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff943192073000): rc 0 00000020:00000080:0.0:1787784712.992096:0:17559:0:(genops.c:885:class_export_put()) final put ffff943192073000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1787784712.992103:0:17559:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb46dc0d87ae0 00000100:00080000:0.0:1787784712.992134:0:17559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787784712.992138:0:17559:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 3 00000004:00080000:0.0:1787784712.992151:0:17559:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:3.0:1787784712.992318:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787784712.992326:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943185611400/0xffb8d925c20bb9d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bb9db expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.992333:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611400 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:3.0:1787784712.992347:0:14404:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943185611400/0xffb8d925c20bb9d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bb9db expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.992378:0:14404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943185611400/0xffb8d925c20bb9d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20bb9db expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784712.992386:0:14404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943185611400/0xffb8d925c20bb9d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20bb9db expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784712.992391:0:14404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787784712.992394:0:14404:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1787784712.992396:0:14404:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1787784712.992430:0:14404:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff943185611400/0xffb8d925c20bb9d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bb9db expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.992436:0:14404:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784712.992453:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943185611400/0xffb8d925c20bb9d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bb9db expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.992459:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943185611400/0xffb8d925c20bb9d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bb9db expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.992470:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787784712.992473:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bbc66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bbc6d expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.992478:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0000 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:3.0:1787784712.992481:0:14404:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bbc66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bbc6d expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.992488:0:14404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bbc66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20bbc6d expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784712.992503:0:14404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bbc66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20bbc6d expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784712.992508:0:14404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787784712.992511:0:14404:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787784712.992512:0:14404:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787784712.992524:0:14404:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bbc66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bbc6d expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.992529:0:14404:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784712.992546:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bbc66 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bbc6d expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.992553:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bbc66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bbc6d expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.992567:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787784712.992570:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431bf500200/0xffb8d925c20bbde0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bbde7 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.992575:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500200 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:3.0:1787784712.992578:0:14404:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431bf500200/0xffb8d925c20bbde0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bbde7 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.992598:0:14404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431bf500200/0xffb8d925c20bbde0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20bbde7 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784712.992606:0:14404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431bf500200/0xffb8d925c20bbde0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20bbde7 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784712.992621:0:14404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787784712.992623:0:14404:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787784712.992625:0:14404:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787784712.992638:0:14404:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431bf500200/0xffb8d925c20bbde0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bbde7 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.992644:0:14404:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784712.992650:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431bf500200/0xffb8d925c20bbde0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bbde7 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.992656:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431bf500200/0xffb8d925c20bbde0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bbde7 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.992663:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784712.992667:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20bb9c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bb9cd expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.992672:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610800 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:3.0:1787784712.992674:0:14404:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20bb9c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bb9cd expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.992680:0:14404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20bb9c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20bb9cd expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784712.992685:0:14404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20bb9c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20bb9cd expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784712.992690:0:14404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787784712.992692:0:14404:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787784712.992694:0:14404:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787784712.992723:0:14404:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20bb9c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bb9cd expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.992729:0:14404:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784712.992735:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20bb9c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bb9cd expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.992740:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20bb9c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bb9cd expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.992750:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784712.992751:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784712.992753:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784712.992768:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:459db144-24ce-4979-944c-65e392f5ff2a:3296:1874627643168640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784712.993057:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784712.993107:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784712.993114:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:459db144-24ce-4979-944c-65e392f5ff2a:3296:1874627643169024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784712.993136:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784712.993162:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:459db144-24ce-4979-944c-65e392f5ff2a:3293:1874627643168768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784712.993183:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784712.993200:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784712.993204:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:459db144-24ce-4979-944c-65e392f5ff2a:3293:1874627643168896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784712.993236:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784712.993257:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643168640 00000100:00100000:3.0:1787784712.993263:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643168640 00000100:00100000:3.0:1787784712.993297:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643169024 00000100:00100000:3.0:1787784712.993300:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643169024 00000100:00100000:3.0:1787784712.993310:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643168768 00000100:00100000:3.0:1787784712.993312:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643168768 00000100:00100000:3.0:1787784712.993320:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643168896 00000100:00100000:3.0:1787784712.993329:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643168896 00000100:00100000:3.0:1787784712.993357:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787784712.993385:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:459db144-24ce-4979-944c-65e392f5ff2a+22:3296:x1874627643168640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784712.993398:0:14401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784712.993412:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431829d1600/0xffb8d925c20bb9db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20bb9d4 expref: 22 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.993424:0:14401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784712.993455:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:459db144-24ce-4979-944c-65e392f5ff2a+21:3296:x1874627643168640:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784712.993462:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787784712.993485:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787784712.993490:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:459db144-24ce-4979-944c-65e392f5ff2a+20:3296:x1874627643169024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784712.993497:0:14401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784712.993504:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431829d1000/0xffb8d925c20bb9cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20bb9c6 expref: 20 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.993514:0:14401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784712.993533:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:459db144-24ce-4979-944c-65e392f5ff2a+19:3296:x1874627643169024:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784712.993538:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787784712.993548:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787784712.993553:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b299fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:459db144-24ce-4979-944c-65e392f5ff2a+18:3293:x1874627643168768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784712.993560:0:14401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784712.993567:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf501400/0xffb8d925c20bbc6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20bbc66 expref: 18 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.993588:0:14401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784712.993616:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b299fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:459db144-24ce-4979-944c-65e392f5ff2a+17:3293:x1874627643168768:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784712.993622:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787784712.993634:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787784712.993639:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:459db144-24ce-4979-944c-65e392f5ff2a+16:3293:x1874627643168896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784712.993646:0:14401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784712.993653:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94308269f000/0xffb8d925c20bbde7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20bbde0 expref: 16 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784712.993661:0:14401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784712.993678:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:459db144-24ce-4979-944c-65e392f5ff2a+15:3293:x1874627643168896:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784712.993683:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787784712.993710:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:459db144-24ce-4979-944c-65e392f5ff2a:3293:1874627643168896:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787784712.994161:0:17559:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787784712.994182:0:17559:0:(import.c:65:import_set_state_nolock()) ffff9431b42ba800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787784712.994202:0:17559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787784712.994206:0:17559:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1787784712.994271:0:17559:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787784712.994352:0:17559:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787784712.994379:0:17559:0:(import.c:65:import_set_state_nolock()) ffff943190323000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787784712.994408:0:17559:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff943185780000) has no exports 00000100:00100000:3.0:1787784712.994541:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:459db144-24ce-4979-944c-65e392f5ff2a:3293:1874627643168768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784712.994574:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:459db144-24ce-4979-944c-65e392f5ff2a:3296:1874627643169024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784712.994648:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:459db144-24ce-4979-944c-65e392f5ff2a:3296:1874627643168640:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784712.994668:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784712.994748:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189163c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:459db144-24ce-4979-944c-65e392f5ff2a+14:3295:x1874627643168512:12345-0@lo:103:ldlm_bl.0 Request processed in 6890us (7808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784712.994757:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:00000080:2.0:1787784712.994792:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bee36000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787784712.994840:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff943192073000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787784712.994861:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431bee34000 for lustre-MDT0000 00000020:00000080:2.0:1787784712.994865:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff943192073800 for lustre-MDT0000 00000100:00100000:2.0:1787784712.995054:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643169152:0@lo:9:umount.0 00000100:00100000:2.0:1787784712.995097:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784712.995133:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643169280:0@lo:9:umount.0 00000100:00100000:2.0:1787784712.995152:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784712.995182:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643169152 00000100:00100000:2.0:1787784712.995187:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643169152 00000100:00100000:2.0:1787784712.995532:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643169280 00000100:00100000:2.0:1787784712.995537:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643169280 00000100:00100000:2.0:1787784712.995560:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787784712.995568:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1874627643169152:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787784712.995602:0:15102:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bbb40 00000100:00080000:2.0:1787784712.995611:0:15102:0:(import.c:65:import_set_state_nolock()) ffff9431bf6e9800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787784712.995647:0:15102:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:2.0:1787784712.996303:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3292:x1874627643169152:12345-0@lo:9:umount.0 Request processed in 734us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784712.996325:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787784712.996351:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787784712.996359:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1874627643169280:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787784712.996391:0:15102:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bbc74 00000100:00080000:2.0:1787784712.996398:0:15102:0:(import.c:65:import_set_state_nolock()) ffff9431bea56800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787784712.996425:0:15102:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1787784712.996804:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3292:x1874627643169280:12345-0@lo:9:umount.0 Request processed in 445us (1649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784712.996811:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787784712.996832:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787784712.996836:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787784712.996848:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787784712.996878:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431b42ba800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787784712.996968:0:3292:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787784712.996971:0:3292:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787784712.996975:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643169152:0@lo:9:umount.0 00000100:00080000:2.0:1787784712.996992:0:3292:0:(import.c:65:import_set_state_nolock()) ffff943190323000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787784712.997002:0:3292:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787784712.997003:0:3292:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787784712.997006:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643169280:0@lo:9:umount.0 00010000:00010000:2.0:1787784712.997034:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784712.997844:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643168512:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1787784713.008156:0:17559:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff943185780000) has no exports 00000020:00000080:1.0:1787784713.099097:0:17559:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bba21 00000020:00000080:1.0:1787784713.099116:0:17559:0:(genops.c:885:class_export_put()) final put ffff943185725000/lustre-QMT0000_UUID 00000020:01000000:1.0:1787784713.099208:0:17559:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787784713.100736:0:17559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787784713.100753:0:17559:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787784713.100759:0:17559:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9431908f8000) has no exports 00000020:00000080:3.0:1787784713.105310:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff943185725000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787784713.109878:0:17559:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bba1a 00000020:00000080:0.0:1787784713.110400:0:17559:0:(genops.c:885:class_export_put()) final put ffff943185724800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787784713.110534:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff943185724800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787784713.110659:0:17559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784713.110671:0:17559:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787784713.110675:0:17559:0:(genops.c:885:class_export_put()) final put ffff943185720000/lustre-QMT0000_UUID 00000020:00000080:2.0:1787784713.110677:0:17559:0:(genops.c:844:class_export_destroy()) destroying export ffff943185720000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787784713.110682:0:17559:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1787784713.140612:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784714.171454:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784715.060771:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643169536:0@lo:400:kworker.0 00000100:00100000:0.0:1787784715.060860:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784715.061052:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784715.061067:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643169408:0@lo:400:kworker.0 00000100:00100000:1.0:1787784715.061103:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784715.061193:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643169664:0@lo:400:kworker.0 00000100:00100000:2.0:1787784715.061224:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784715.061331:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643169536 00000100:00100000:3.0:1787784715.061338:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643169536 00000100:00100000:3.0:1787784715.061394:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643169664 00000100:00100000:3.0:1787784715.061398:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643169664 00000100:00100000:3.0:1787784715.061417:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787784715.061426:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3293:x1874627643169536:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787784715.061448:0:16294:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787784715.061510:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3293:x1874627643169536:12345-0@lo:400:kworker.0 Request processed in 84us (650us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787784715.061518:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787784715.061537:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787784715.061541:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3294:x1874627643169664:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787784715.061546:0:16294:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787784715.061567:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3294:x1874627643169664:12345-0@lo:400:kworker.0 Request processed in 25us (343us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787784715.061573:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1787784715.063157:0:3293:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787784715.063175:0:3293:0:(import.c:65:import_set_state_nolock()) ffff9431bf6eb000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787784715.063180:0:3293:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1787784715.067597:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643169408 00000100:00100000:3.0:1787784715.067613:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643169408 00000100:00100000:3.0:1787784715.067676:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787784715.067686:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2983450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+14:3295:x1874627643169408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784715.067789:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2983450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+14:3295:x1874627643169408:12345-0@lo:400:kworker.0 Request processed in 104us (6684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784715.067797:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787784715.073940:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643169408:0@lo:400:kworker.0 00000100:00080000:2.0:1787784715.077211:0:3294:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787784715.077219:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9431857db800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787784715.077224:0:3294:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787784715.077240:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9431857db800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787784715.077245:0:3294:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 473 00000100:00080000:2.0:1787784715.077254:0:3294:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9431857db800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:2.0:1787784715.077296:0:3294:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431b45b61c0 x1874627643169792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787784715.077342:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643169664:0@lo:400:kworker.0 00000100:00100000:3.0:1787784715.077404:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1874627643169792:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1787784715.077473:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784715.077580:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643169792 00000100:00100000:2.0:1787784715.077587:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643169792 00000100:00100000:2.0:1787784715.077631:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787784715.077648:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3292:x1874627643169792:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1787784715.077665:0:16294:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787784715.097994:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3292:x1874627643169792:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 20224us (20390us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787784715.098012:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1787784715.102590:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431857db800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787784715.102602:0:3292:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787784715.102607:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1874627643169792:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1787784715.108412:0:3293:0:(import.c:65:import_set_state_nolock()) ffff9431bf6eb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784715.108428:0:3293:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 457 00000100:00080000:0.0:1787784715.108439:0:3293:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9431bf6eb000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:0.0:1787784715.108484:0:3293:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431b45af0c0 x1874627643169920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787784715.108527:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643169536:0@lo:400:kworker.0 00000100:00100000:3.0:1787784715.108810:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1874627643169920:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787784715.108878:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784715.109064:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643169920 00000100:00100000:0.0:1787784715.109072:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643169920 00000100:00100000:0.0:1787784715.109118:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787784715.109126:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3292:x1874627643169920:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1787784715.109143:0:14415:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787784715.109200:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3292:x1874627643169920:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 73us (321us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787784715.109207:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1787784715.109301:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431bf6eb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784715.109307:0:3292:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787784715.109310:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1874627643169920:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:2.0:1787784715.188903:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787784715.632222:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787784715.632231:0:7631:0:(genops.c:885:class_export_put()) final put ffff9431bea54800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787784715.632480:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bea54800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787784715.632594:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431bea56800 for lustre-OST0001 00000001:00100000:2.0:1787784716.135353:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e94ca4a8-f17e-4bfb-939c-0ba59f45e136 00000001:00080000:2.0:1787784716.135407:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:2.0:1787784716.135414:0:5853:0:(genops.c:885:class_export_put()) final put ffff9431bea50000/e94ca4a8-f17e-4bfb-939c-0ba59f45e136 00000020:00000080:0.0:1787784716.136256:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bea50000/e94ca4a8-f17e-4bfb-939c-0ba59f45e136 for lustre-MDT0000 00000020:00000080:0.0:1787784716.136508:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431bea56000 for lustre-MDT0000 00010000:00010000:2.0:1787784716.215782:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787784716.668247:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787784716.668256:0:6703:0:(genops.c:885:class_export_put()) final put ffff9431bf6ef000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787784716.668332:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bf6ef000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787784716.668407:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431bf6e9800 for lustre-OST0000 00010000:00010000:2.0:1787784717.236599:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784718.262158:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787784719.156854:0:17559:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff943186fe6360 - data ffff9431ad01a510/ffff94308359cc00 00000020:01000000:0.0:1787784719.157019:0:17559:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff943186fb4600 - data ffff94319dbfd5e8/ffff9431b62f9000 00000001:00000004:0.0:1787784719.166434:0:17559:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:3.0:1787784719.241477:0:17559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787784719.241488:0:17559:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 4 00000004:00080000:3.0:1787784719.241578:0:17559:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787784719.241582:0:17559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787784719.241996:0:14438:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787784719.242001:0:14438:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:1.0:1787784719.242010:0:14438:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1787784719.243582:0:17559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787784719.243587:0:17559:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1787784719.243652:0:17559:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787784719.243655:0:17559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787784719.244216:0:14440:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787784719.244221:0:14440:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:0.0:1787784719.244230:0:14440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1787784719.281075:0:17559:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bb9e9 00000020:00000080:3.0:1787784719.281087:0:17559:0:(genops.c:885:class_export_put()) final put ffff9431b5c48000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787784719.281492:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b5c48000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787784719.282023:0:17559:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bb9fe 00000020:00000080:3.0:1787784719.282030:0:17559:0:(genops.c:885:class_export_put()) final put ffff9431b42ba000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787784719.282082:0:17559:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787784719.282089:0:17559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784719.282098:0:17559:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787784719.282102:0:17559:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff943185784d28) has no exports 00000004:01000000:3.0:1787784719.282260:0:17559:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787784719.282268:0:17559:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bba4b 00000020:00000080:3.0:1787784719.282272:0:17559:0:(genops.c:885:class_export_put()) final put ffff9431b42bc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787784719.282926:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b42ba000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787784719.283003:0:17559:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787784719.283009:0:17559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784719.283015:0:17559:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787784719.283018:0:17559:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9431b6260000) has no exports 00000020:00000080:3.0:1787784719.283025:0:17559:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bba44 00000020:00000080:3.0:1787784719.283030:0:17559:0:(genops.c:885:class_export_put()) final put ffff943190321000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787784719.283500:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b42bc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787784719.283508:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff943190321000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787784719.283572:0:17559:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787784719.283577:0:17559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787784719.283580:0:17559:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1787784719.283585:0:17559:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787784719.283587:0:17559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787784719.283640:0:17559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784719.283647:0:17559:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787784719.283653:0:17559:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bba36 00000020:00000080:3.0:1787784719.283658:0:17559:0:(genops.c:885:class_export_put()) final put ffff9431b42be000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787784719.283681:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff943190323000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787784719.283687:0:37:0:(genops.c:885:class_export_put()) final put ffff9431b42bb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787784719.283690:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b42bb000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787784719.283695:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787784719.284129:0:17559:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787784719.284143:0:17559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784719.284148:0:17559:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787784719.284151:0:17559:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9431b6264d28) has no exports 00000020:00000080:3.0:1787784719.284156:0:17559:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bba2f 00000020:00000080:3.0:1787784719.284160:0:17559:0:(genops.c:885:class_export_put()) final put ffff9431b42bf800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787784719.284496:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b42be000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787784719.284502:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b42bf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787784719.284629:0:17559:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787784719.284632:0:17559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787784719.284635:0:17559:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 5 00000004:00080000:3.0:1787784719.284639:0:17559:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787784719.284641:0:17559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787784719.284678:0:17559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784719.284683:0:17559:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787784719.284708:0:17559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784719.284711:0:17559:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787784719.284715:0:17559:0:(genops.c:885:class_export_put()) final put ffff9431b5c4c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787784719.284717:0:17559:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b5c4c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787784719.284723:0:17559:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787784719.284946:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431b42ba800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787784719.284953:0:37:0:(genops.c:885:class_export_put()) final put ffff9431b42bb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787784719.284956:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b42bb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787784719.284963:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787784719.285065:0:17559:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bba05 00000020:00000080:3.0:1787784719.285072:0:17559:0:(genops.c:885:class_export_put()) final put ffff9431b42b8000/lustre-MDD0000_UUID 00000020:01000000:3.0:1787784719.285113:0:17559:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1787784719.285117:0:17559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784719.285121:0:17559:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787784719.285124:0:17559:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9431857819b8) has no exports 00000020:00000080:3.0:1787784719.285149:0:17559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784719.285153:0:17559:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1787784719.285156:0:17559:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bba0c 00000020:00000080:3.0:1787784719.285159:0:17559:0:(genops.c:885:class_export_put()) final put ffff9431b42bd800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787784719.285500:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b42b8000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787784719.285504:0:37:0:(genops.c:885:class_export_put()) final put ffff9431b5c49000/lustre-MDD0000_UUID 00000020:00000080:1.0:1787784719.285505:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b5c49000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787784719.285508:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00010000:00010000:0.0:1787784719.285646:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787784719.285707:0:17559:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9431b9fc6000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1787784719.285711:0:17559:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9431b9fc6000 3 00000020:01000004:3.0:1787784719.285714:0:17559:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9431b9fc6000 from lustre-MDT0000 00000020:00000080:3.0:1787784719.285732:0:17559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784719.285736:0:17559:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1787784719.285747:0:17559:0:(genops.c:885:class_export_put()) final put ffff9431b5c4d800/lustre-MDT0000_UUID 00000020:00000080:3.0:1787784719.285750:0:17559:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b5c4d800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1787784719.285756:0:17559:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1787784719.285787:0:17559:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1787784719.285791:0:17559:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1787784719.285794:0:17559:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1787784719.285797:0:17559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784719.285799:0:17559:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787784719.285806:0:17559:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9431bedb7800 459db144-24ce-4979-944c-65e392f5ff2a 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787784719.285812:0:17559:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff943185783370) has exports, disconnecting them 00000020:00080000:3.0:1787784719.285817:0:17559:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9431bedb7800), last request at 1787784627 00000020:00000080:1.0:1787784719.285904:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b42bd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787784719.285928:0:17559:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bb9b1 00000020:00010000:3.0:1787784719.285932:0:17559:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9431bedb7800: total 0 00000100:00080000:3.0:1787784719.285935:0:17559:0:(import.c:65:import_set_state_nolock()) ffff9431bedb4000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787784719.285948:0:17559:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9431bedb7800): rc 0 00000020:00080000:3.0:1787784719.285951:0:17559:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff943185783370) has no exports 00000100:00100000:3.0:1787784719.285996:0:14411:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9431bf224200:14411] 2 exiting: rc = 0 00000100:00100000:3.0:1787784719.286083:0:14408:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9431bf224400:14408] 0 exiting: rc = 1 00000100:00100000:1.0:1787784719.286161:0:14410:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9431864e3200:14410] 1 exiting: rc = 0 00000020:00010000:0.0:1787784719.286217:0:14404:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9431bedb7800: total 0 00010000:00010000:0.0:1787784719.286242:0:14404:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9431bedb7800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787784719.286264:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94308269e000/0xffb8d925c20bbdcb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20bbdc4 expref: 9 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784719.286275:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf500400/0xffb8d925c20bb9bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20bb9b8 expref: 8 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784719.286292:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94308269e600/0xffb8d925c20bbdd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20bbdd2 expref: 7 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784719.286303:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431829d1a00/0xffb8d925c20bbc19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20bbc12 expref: 6 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784719.286310:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bee88a00/0xffb8d925c20bbae5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20bbade expref: 5 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784719.286324:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431829d0800/0xffb8d925c20bbad7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20bbad0 expref: 4 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784719.286335:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943185610600/0xffb8d925c20bbc43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20bbc3c expref: 3 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784719.286345:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943185611200/0xffb8d925c20bbb0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20bbb08 expref: 2 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784719.286355:0:14404:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9431bedb7800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1787784719.286394:0:14404:0:(genops.c:885:class_export_put()) final put ffff9431bedb7800/459db144-24ce-4979-944c-65e392f5ff2a 00010000:00010000:0.0:1787784719.286404:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787784719.286492:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bedb7800/459db144-24ce-4979-944c-65e392f5ff2a for MGS 00000020:00000080:1.0:1787784719.286515:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431bedb4000 for MGS 00010000:00010000:0.0:1787784719.286538:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784719.286540:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784719.286586:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286591:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286596:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286599:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286603:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286607:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286611:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286615:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286619:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286624:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286628:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286632:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286638:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286645:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286661:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286669:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286675:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286680:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286686:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286693:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286699:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286704:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286707:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286712:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286718:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286723:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286728:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286733:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286739:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286745:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286751:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286756:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286762:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286776:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286783:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286789:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286794:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286800:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286805:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286811:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286816:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286821:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286891:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286900:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286907:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286912:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286916:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286919:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286923:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286932:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286935:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286939:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286942:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286946:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286950:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286954:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286957:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286961:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286964:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286968:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286971:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286974:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286978:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.286981:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1787784719.287276:0:17559:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787784719.287278:0:17559:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1787784719.289191:0:17559:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94318909be40 - data ffff9431bfe7fd80/ffff9430826b6c00 00000020:01000000:3.0:1787784719.289303:0:17559:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff943190944de0 - data ffff94318a2ee948/ffff9431b9535800 00000020:00000080:3.0:1787784719.290012:0:17559:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bb995 00000020:00000080:3.0:1787784719.290021:0:17559:0:(genops.c:885:class_export_put()) final put ffff9431bf3c6800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787784719.290038:0:17559:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9431b9fc6000 from MGS, refs=2 00000020:01000004:3.0:1787784719.290042:0:17559:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9431b9fc6000 2 00000020:01000004:3.0:1787784719.290044:0:17559:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9431b9fc6000 from MGS 00000020:00000080:3.0:1787784719.290065:0:17559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784719.290071:0:17559:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787784719.290074:0:17559:0:(genops.c:885:class_export_put()) final put ffff9431bf3c7800/MGS 00000020:00000080:3.0:1787784719.290077:0:17559:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bf3c7800/MGS for MGS 00000020:01000000:3.0:1787784719.290083:0:17559:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787784719.290137:0:17559:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787784719.290141:0:17559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784719.290147:0:17559:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787784719.290154:0:17559:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9431b29f1800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787784719.290159:0:17559:0:(genops.c:1553:class_disconnect_exports()) OBD device 10 (ffff9431b9ec99b8) has exports, disconnecting them 00000020:00080000:3.0:1787784719.290174:0:17559:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9431b29f1800), last request at 1787784627 00000020:00000080:3.0:1787784719.290179:0:17559:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bba83 00000020:00080000:3.0:1787784719.290189:0:17559:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9431b29f1800): rc 0 00000020:00000080:3.0:1787784719.290193:0:17559:0:(genops.c:885:class_export_put()) final put ffff9431b29f1800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787784719.290996:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bf3c6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787784719.291004:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b29f1800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1787784719.296644:0:17559:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1787784719.296655:0:17559:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787784719.296664:0:17559:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787784719.296672:0:17559:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787784719.296869:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431904c0800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787784719.297201:0:17559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784719.297209:0:17559:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787784719.297215:0:17559:0:(genops.c:885:class_export_put()) final put ffff9431b29f4000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787784719.297219:0:17559:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b29f4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787784719.297227:0:17559:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1787784719.297298:0:17559:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9431b9fc6000 1 00000020:00000080:3.0:1787784719.297304:0:17559:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bb987 00000020:00000080:3.0:1787784719.297310:0:17559:0:(genops.c:885:class_export_put()) final put ffff9431bf3c2800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1787784719.297316:0:17559:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1787784719.297320:0:17559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784719.297324:0:17559:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787784719.297336:0:17559:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9431b9eccd28) has no exports 00000020:00000080:1.0:1787784719.297360:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bf3c2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787784719.317994:0:17559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787784719.318010:0:17559:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787784719.318028:0:17559:0:(genops.c:885:class_export_put()) final put ffff9431b9fc0000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787784719.318034:0:17559:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b9fc0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787784719.318045:0:17559:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787784719.318175:0:17559:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9431b9fc0800 00000020:01000000:1.0:1787784719.318196:0:17559:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787784719.318201:0:17559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787784719.318205:0:17559:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787784719.318209:0:17559:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9431908fb370) has no exports 00000100:00100000:3.0:1787784719.320130:0:14416:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff943186e01600:14416] 1 exiting: rc = 0 00000100:00100000:0.0:1787784719.320553:0:14417:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9431b3d69200:14417] 2 exiting: rc = 0 00000100:00100000:0.0:1787784719.320619:0:14415:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9431863f2e00:14415] 0 exiting: rc = 1 00000100:00100000:2.0:1787784719.321082:0:16294:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9431bed45a00:16294] 3 exiting: rc = 0 00000100:00100000:1.0:1787784719.323259:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323272:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323277:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323295:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323301:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323308:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323314:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323318:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323323:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323329:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323334:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323340:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323345:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323351:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323356:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323386:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323394:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323400:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323405:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323637:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323642:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323649:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323654:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323660:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323666:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323672:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323697:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323703:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323708:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323714:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323719:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323724:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323729:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323734:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323738:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323743:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323749:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323756:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323761:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323765:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323770:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323775:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323780:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323786:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323790:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323796:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323801:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323805:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323811:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323817:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323822:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323894:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323902:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323932:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323940:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323945:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323951:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323956:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323962:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323967:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323973:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323986:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323993:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787784719.323999:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.328144:0:14418:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9431b9fb4a00:14418] 0 exiting: rc = 1 00000100:00100000:1.0:1787784719.328270:0:14419:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9431b9fb5e00:14419] 1 exiting: rc = 0 00000100:00100000:0.0:1787784719.328538:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328547:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328555:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328561:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328566:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328571:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328576:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328580:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328585:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328592:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328598:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328603:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328608:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328613:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328618:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328642:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328646:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328652:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328657:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328662:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328667:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328672:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328677:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328681:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328686:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328691:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328696:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328701:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328706:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328711:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328717:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328722:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328727:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328732:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328736:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328742:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328747:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328752:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328758:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328764:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328769:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328774:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328779:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328785:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328790:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328795:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328800:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328805:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328810:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328814:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.328826:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.329171:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.329177:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.329182:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.329187:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.329192:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.329196:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.329200:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.329205:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.329209:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.329214:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.329219:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.329224:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.329228:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330076:0:14421:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9431b9fb5200:14421] 1 exiting: rc = 0 00000100:00100000:1.0:1787784719.330253:0:14420:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9431864e2800:14420] 0 exiting: rc = 1 00000100:00100000:0.0:1787784719.330633:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330661:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330668:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330674:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330679:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330685:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330691:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330697:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330703:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330709:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330715:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330720:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330726:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330746:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330753:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330759:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330765:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330771:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330777:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330783:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330802:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330809:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330815:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330821:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330838:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330860:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330868:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330874:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330880:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330887:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330893:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330900:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330906:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330912:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330918:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330924:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330931:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330953:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330961:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330967:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330973:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330980:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330986:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330992:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.330998:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.331004:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.331010:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.331016:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.331021:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.331041:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.331048:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.331054:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.331060:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.331066:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.331071:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.331084:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.331090:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.331096:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.331103:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.331109:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.331114:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.331134:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.331141:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.331147:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.340706:0:14422:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9431b9fb4000:14422] 0 exiting: rc = 1 00000100:00100000:1.0:1787784719.340913:0:14423:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff943190b05c00:14423] 1 exiting: rc = 0 00000100:00100000:0.0:1787784719.341254:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341261:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341268:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341274:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341291:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341298:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341303:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341308:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341313:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341318:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341324:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341329:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341335:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341341:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341347:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341351:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341356:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341361:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341508:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341513:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341518:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341524:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341529:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341534:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341540:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341545:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341564:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341570:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341575:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341581:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341586:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341591:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341597:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341602:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341608:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341614:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341620:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341625:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341630:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341635:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341641:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341647:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341652:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341657:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341663:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341667:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341672:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341676:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341680:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341685:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341689:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341693:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341698:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341702:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341707:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341712:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341716:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341721:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341727:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341731:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341737:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341750:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341755:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.341759:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.342636:0:14425:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff943190b05000:14425] 1 exiting: rc = 0 00000100:00100000:1.0:1787784719.342819:0:14424:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff943190b05200:14424] 0 exiting: rc = 1 00000100:00100000:0.0:1787784719.343211:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343219:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343224:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343230:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343236:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343241:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343246:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343251:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343257:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343262:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343267:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343272:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343277:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343294:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343299:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343304:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343309:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343316:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343321:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343326:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343331:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343336:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343342:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343347:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343351:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343356:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343361:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343396:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343401:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343536:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343544:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343549:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343566:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343571:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343575:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343580:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343586:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343590:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343595:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343601:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343605:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343610:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343615:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343620:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343624:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343628:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343633:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343638:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343643:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343647:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343653:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343658:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343664:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343669:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343675:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343679:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343684:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343689:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343694:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343698:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343703:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343708:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343712:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.343717:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.344645:0:14426:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff943190b04200:14426] 0 exiting: rc = 1 00000100:00100000:1.0:1787784719.344777:0:14427:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff943191a1e200:14427] 1 exiting: rc = 0 00000100:00100000:0.0:1787784719.344912:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.344920:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.344925:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.344940:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.344945:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.344949:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.344954:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.344959:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.344963:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.344968:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.344972:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.344977:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.344982:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.344987:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.344992:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.344997:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345002:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345007:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345011:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345016:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345021:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345027:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345032:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345037:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345042:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345047:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345052:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345057:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345062:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345066:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345071:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345076:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345081:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345086:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345091:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345096:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345101:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345106:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345118:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345123:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345128:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345133:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345138:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345144:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345150:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345155:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345160:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345166:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345171:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345176:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345181:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345186:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345191:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345197:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345202:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345207:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345212:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345215:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345219:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345222:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345225:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345228:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345231:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.345235:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784719.345743:0:14428:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9431bf676400:14428] 0 exiting: rc = 1 00000100:00100000:1.0:1787784719.345965:0:14429:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff943191a1e800:14429] 1 exiting: rc = 0 00000100:00100000:1.0:1787784719.346125:0:14430:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff943191a1f400:14430] 2 exiting: rc = 0 00000100:00100000:0.0:1787784719.346247:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346255:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346260:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346266:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346272:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346278:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346295:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346301:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346307:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346321:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346327:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346333:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346339:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346345:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346351:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346356:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346390:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346398:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346404:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346497:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346515:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346522:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346527:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346533:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346538:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346542:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346545:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346550:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346554:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346558:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346562:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346565:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346569:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346572:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346576:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346580:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346584:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346587:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346590:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346594:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346597:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346602:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346605:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346609:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346628:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346633:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346640:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346645:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346651:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346656:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346661:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346669:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346674:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346681:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346686:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346691:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346696:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346700:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346707:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346711:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346714:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346718:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346722:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784719.346727:0:17559:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787784719.351603:0:17559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784719.351616:0:17559:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787784719.351622:0:17559:0:(genops.c:885:class_export_put()) final put ffff9431b9fff800/MDS_uuid 00000020:00000080:0.0:1787784719.351626:0:17559:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b9fff800/MDS_uuid for MDS 00000020:01000000:0.0:1787784719.351634:0:17559:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787784719.351778:0:17559:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:0.0:1787784720.180597:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787784720.180604:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787784720.180608:0:38:0:(import.c:65:import_set_state_nolock()) ffff9431bf6eb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784720.180617:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 529 00000100:00080000:0.0:1787784720.180624:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787784720.180631:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9431bf6eb000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:0.0:1787784720.180658:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431b45ade00 x1874627643170176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784720.180692:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787784720.180696:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787784720.180698:0:38:0:(import.c:65:import_set_state_nolock()) ffff9431857db800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784720.180702:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 529 00000100:00080000:0.0:1787784720.180706:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787784720.180709:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9431857db800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:0.0:1787784720.180722:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431b45ac780 x1874627643170304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787784720.180752:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1874627643170176:0@lo:38:kworker.0 00000400:00000100:0.0:1787784720.180804:0:3292:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874627643170176 offset 0 length 520: 4 00000100:00100000:0.0:1787784720.180855:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1874627643170304:0@lo:38:kworker.0 00000400:00000100:0.0:1787784720.180873:0:3292:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874627643170304 offset 0 length 520: 4 00000100:00100000:2.0:1787784720.180956:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784720.180967:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:459db144-24ce-4979-944c-65e392f5ff2a:3296:1874627643170048:0@lo:400:kworker.0 00000400:00000100:2.0:1787784720.180991:0:3296:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874627643170048 offset 0 length 224: 4 00010000:00010000:0.0:1787784720.308641:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784721.333846:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784722.357359:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787784722.417182:0:17716:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787784722.434941:0:17716:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787784722.435007:0:17716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf501000/0xffb8d925c20bbb08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbb0f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784722.435026:0:17716:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf501000/0xffb8d925c20bbb08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bbb0f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784722.435034:0:17716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf501000/0xffb8d925c20bbb08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bbb0f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784722.435042:0:17716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff9431bf501000/0xffb8d925c20bbb08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bbb0f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784722.435091:0:17716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787784722.435100:0:17716:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787784722.435129:0:17716:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787784722.435144:0:17716:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9431b45ade00 x1874627643170176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787784735 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784722.435172:0:17716:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787784722.435180:0:17716:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787784722.435188:0:17716:0:(import.c:65:import_set_state_nolock()) ffff9431bf6eb000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787784722.435194:0:17716:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787784722.435198:0:17716:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9431b45ade00 x1874627643170176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787784735 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784722.435204:0:17716:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787784722.435207:0:17716:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:1.0:1787784722.435950:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1874627643170176:0@lo:38:kworker.0 00010000:00010000:2.0:1787784722.438448:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784722.438466:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431bf501000/0xffb8d925c20bbb08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bbb0f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784722.438481:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501000 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:2.0:1787784722.438486:0:14404:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431bf501000/0xffb8d925c20bbb08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bbb0f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784722.438499:0:14404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431bf501000/0xffb8d925c20bbb08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20bbb0f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784722.438508:0:14404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431bf501000/0xffb8d925c20bbb08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20bbb0f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784722.438514:0:14404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787784722.438517:0:14404:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787784722.438546:0:14404:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787784722.438604:0:14404:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431bf501000/0xffb8d925c20bbb08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bbb0f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784722.438613:0:14404:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784722.438655:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431bf501000/0xffb8d925c20bbb08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bbb0f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784722.438664:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431bf501000/0xffb8d925c20bbb08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bbb0f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784722.438683:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784722.438685:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784722.438687:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784722.438761:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:459db144-24ce-4979-944c-65e392f5ff2a:3296:1874627643170432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784722.438848:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784722.439014:0:16535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643170432 00000100:00100000:2.0:1787784722.439025:0:16535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643170432 00010000:00010000:0.0:1787784722.439074:0:17716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf501a00/0xffb8d925c20bbade lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbae5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784722.439089:0:17716:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf501a00/0xffb8d925c20bbade lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bbae5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784722.439098:0:17716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf501a00/0xffb8d925c20bbade lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bbae5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784722.439105:0:17716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff9431bf501a00/0xffb8d925c20bbade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bbae5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784722.439138:0:16535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1787784722.439138:0:17716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787784722.439150:0:17716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20bbdd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbdd9 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784722.439153:0:16535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3296:x1874627643170432:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787784722.439164:0:16535:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787784722 with bad export cookie 18426716631578950065 00010000:00010000:3.0:1787784722.439212:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784722.439230:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431bf501a00/0xffb8d925c20bbade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bbae5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784722.439239:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501a00 already unused, calling callback (ffffffffc1c19c20) 00010000:00010000:0.0:1787784722.439297:0:17716:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20bbdd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bbdd9 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784722.439321:0:14405:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431bf501a00/0xffb8d925c20bbade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bbae5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784722.439331:0:14405:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431bf501a00/0xffb8d925c20bbade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20bbae5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784722.439338:0:14405:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431bf501a00/0xffb8d925c20bbade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20bbae5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784722.439349:0:14405:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787784722.439355:0:14405:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1787784722.439355:0:17716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20bbdd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bbdd9 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784722.439387:0:17716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20bbdd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bbdd9 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784722.439405:0:17716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787784722.439410:0:17716:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1787784722.439414:0:14405:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431bf501a00/0xffb8d925c20bbade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bbae5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784722.439415:0:17716:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:3.0:1787784722.439424:0:14405:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:0.0:1787784722.439439:0:17716:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787784722.439444:0:17716:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:3.0:1787784722.439449:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431bf501a00/0xffb8d925c20bbade lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bbae5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784722.439456:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784722.439458:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431bf501a00/0xffb8d925c20bbade lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bbae5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784722.439475:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784722.439478:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784722.439480:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784722.439493:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:459db144-24ce-4979-944c-65e392f5ff2a:3293:1874627643170560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784722.439525:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1787784722.439635:0:17716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787784722.439642:0:17716:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787784722.439646:0:17716:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9431885e3370) has no exports 00000020:00080000:0.0:1787784722.439670:0:17716:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9431885e3370) has no exports 00000020:01000000:0.0:1787784722.444473:0:17716:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff943081b87300 - data ffff9431ad32d948/ffff9431be904000 00000020:01000000:0.0:1787784722.444625:0:17716:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9430833b0240 - data ffff9431bfccd000/ffff9431b3a2b800 00000100:00100000:1.0:1787784722.446468:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643170560 00000100:00100000:1.0:1787784722.446488:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643170560 00000100:00100000:1.0:1787784722.446582:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787784722.446594:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3293:x1874627643170560:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787784722.446603:0:14402:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787784722 with bad export cookie 18426716631578950065 00000100:00100000:1.0:1787784722.446727:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3293:x1874627643170560:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (7200us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787784722.446735:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1787784722.448179:0:3293:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.159@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787784722.448186:0:3293:0:(import.c:65:import_set_state_nolock()) ffff9431b9ffa000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787784722.448192:0:3293:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:2.0:1787784722.449629:0:16535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3296:x1874627643170432:12345-0@lo:103:ldlm_bl.0 Request processed in 10473us (10776us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787784722.449643:0:16535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1787784722.452467:0:3296:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.159@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:1.0:1787784722.452899:0:17717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784722.452918:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20bbdd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bbdd9 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784722.452933:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0600 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:1.0:1787784722.452939:0:14404:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20bbdd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bbdd9 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784722.452951:0:14404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20bbdd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20bbdd9 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784722.452983:0:14404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20bbdd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20bbdd9 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784722.452990:0:14404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787784722.452993:0:14404:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787784722.452997:0:14404:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787784722.466541:0:17717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784722.466549:0:17717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787784722.476804:0:3293:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.159@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787784722.476811:0:3293:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787784722.476820:0:3293:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9431b45ad2c0 x1874627643170048/t0(0) o400->MGC192.168.202.159@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787784736 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784722.476836:0:3293:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9431b45b43c0 x1874627643170432/t0(0) o103->MGC192.168.202.159@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787784738 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784722.476845:0:3293:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9431962a43c0 x1874627643170560/t0(0) o103->MGC192.168.202.159@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787784738 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787784722.476896:0:3296:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9431b9ffa000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1787784722.476995:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:459db144-24ce-4979-944c-65e392f5ff2a:3296:1874627643170048:0@lo:400:kworker.0 00000100:00100000:2.0:1787784722.477026:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:459db144-24ce-4979-944c-65e392f5ff2a:3296:1874627643170432:0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1787784722.477545:0:3293:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787784722.477549:0:3293:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787784722.477550:0:3293:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787784722.477554:0:3293:0:(import.c:65:import_set_state_nolock()) ffff9431b9ffa000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787784722.477559:0:3293:0:(import.c:510:import_select_connection()) MGC192.168.202.159@tcp: connect to NID 0@lo last attempt 441 00000100:00080000:3.0:1787784722.477567:0:3293:0:(import.c:624:import_select_connection()) MGC192.168.202.159@tcp: import ffff9431b9ffa000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:3.0:1787784722.477596:0:3293:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431962a6d00 x1874627643170688/t0(0) o250->MGC192.168.202.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787784722.477629:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:459db144-24ce-4979-944c-65e392f5ff2a:3293:1874627643170560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784722.478641:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:459db144-24ce-4979-944c-65e392f5ff2a:3292:1874627643170688:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1787784722.478697:0:3292:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874627643170688 offset 0 length 520: 4 00010000:00010000:1.0:1787784722.478700:0:14404:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20bbdd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bbdd9 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784722.478718:0:14404:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784722.478759:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20bbdd2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bbdd9 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784722.478768:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20bbdd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bbdd9 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784722.478779:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431891630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:459db144-24ce-4979-944c-65e392f5ff2a:0:1874627643170816:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787784722.478795:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784722.478799:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784722.478803:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787784722.487533:0:17716:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787784722.532931:0:17716:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bbaf3 00000020:00000080:0.0:1787784722.532943:0:17716:0:(genops.c:885:class_export_put()) final put ffff9431bee32000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787784722.532969:0:17716:0:(tgt_mount.c:187:server_put_mount()) put mount ffff943186233000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787784722.532973:0:17716:0:(obd_mount.c:710:lustre_put_lsi()) put ffff943186233000 2 00000020:01000004:0.0:1787784722.532977:0:17716:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff943186233000 from lustre-OST0000 00000020:00000080:2.0:1787784722.532992:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bee32000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787784722.533009:0:17716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784722.533023:0:17716:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787784722.533027:0:17716:0:(genops.c:885:class_export_put()) final put ffff9431bee34800/lustre-OST0000_UUID 00000020:00000080:0.0:1787784722.533030:0:17716:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bee34800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787784722.533040:0:17716:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787784722.533119:0:17716:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787784722.533123:0:17716:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787784722.534617:0:17716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787784722.534633:0:17716:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787784722.534641:0:17716:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9431bf6ee800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787784722.534648:0:17716:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9431885e4d28) has exports, disconnecting them 00000020:00080000:0.0:1787784722.534653:0:17716:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9431bf6ee800), last request at 1787784642 00000020:00000080:0.0:1787784722.534658:0:17716:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bbb1d 00000020:00080000:0.0:1787784722.534998:0:17716:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9431bf6ee800): rc 0 00000020:00000080:0.0:1787784722.535003:0:17716:0:(genops.c:885:class_export_put()) final put ffff9431bf6ee800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787784722.535969:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bf6ee800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787784722.541509:0:17716:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787784722.541521:0:17716:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787784722.541526:0:17716:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787784722.541533:0:17716:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787784722.541613:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431bf6eb000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787784722.542815:0:17716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784722.542829:0:17716:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1787784722.542835:0:17716:0:(genops.c:885:class_export_put()) final put ffff9431bee31000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787784722.542840:0:17716:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bee31000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787784722.542847:0:17716:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1787784722.543769:0:17716:0:(obd_mount.c:710:lustre_put_lsi()) put ffff943186233000 1 00000020:00000080:0.0:1787784722.543779:0:17716:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bbac2 00000020:00000080:0.0:1787784722.543787:0:17716:0:(genops.c:885:class_export_put()) final put ffff9431bee7a000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787784722.543890:0:17716:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787784722.543897:0:17716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787784722.543904:0:17716:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787784722.543919:0:17716:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9431908fcd28) has no exports 00000020:00000080:1.0:1787784722.547745:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bee7a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787784722.704257:0:17716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787784722.704278:0:17716:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787784722.704285:0:17716:0:(genops.c:885:class_export_put()) final put ffff943186235000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787784722.704291:0:17716:0:(genops.c:844:class_export_destroy()) destroying export ffff943186235000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787784722.704304:0:17716:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787784722.704509:0:17716:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff943186235800 00000020:02000400:1.0:1787784722.704558:0:17716:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787784723.393216:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784724.404833:0:17717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787784725.300637:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 459db144-24ce-4979-944c-65e392f5ff2a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787784725.300648:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 459db144-24ce-4979-944c-65e392f5ff2a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784725.300651:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787784725.300655:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787784725.428706:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787784725.693328:0:17866:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787784725.718632:0:17866:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787784725.718711:0:17866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf500a00/0xffb8d925c20bbc3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbc43 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784725.718728:0:17866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf500a00/0xffb8d925c20bbc3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bbc43 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784725.718736:0:17866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf500a00/0xffb8d925c20bbc3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bbc43 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784725.718744:0:17866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff9431bf500a00/0xffb8d925c20bbc3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bbc43 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784725.718768:0:17866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787784725.718774:0:17866:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787784725.718794:0:17866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787784725.718807:0:17866:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9431b45ac780 x1874627643170304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787784735 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784725.718825:0:17866:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787784725.718832:0:17866:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787784725.718841:0:17866:0:(import.c:65:import_set_state_nolock()) ffff9431857db800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787784725.718846:0:17866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787784725.718850:0:17866:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9431b45ac780 x1874627643170304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787784735 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784725.718858:0:17866:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787784725.718861:0:17866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00010000:00010000:3.0:1787784725.718971:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784725.718978:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431bf500a00/0xffb8d925c20bbc3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bbc43 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784725.718986:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500a00 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:3.0:1787784725.718989:0:14405:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431bf500a00/0xffb8d925c20bbc3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bbc43 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784725.719027:0:14405:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431bf500a00/0xffb8d925c20bbc3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20bbc43 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784725.719034:0:14405:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431bf500a00/0xffb8d925c20bbc3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20bbc43 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784725.719040:0:14405:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787784725.719043:0:14405:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787784725.719046:0:14405:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787784725.719063:0:14405:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9431b9ffa000 00010000:00010000:3.0:1787784725.719068:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431bf500a00/0xffb8d925c20bbc3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xffb8d925c20bbc43 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784725.719074:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431bf500a00/0xffb8d925c20bbc3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xffb8d925c20bbc43 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784725.719090:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784725.719092:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784725.719094:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784725.719455:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1874627643170304:0@lo:38:kworker.0 00010000:00010000:1.0:1787784725.720500:0:17866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185610c00/0xffb8d925c20bbc12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbc19 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784725.720514:0:17866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185610c00/0xffb8d925c20bbc12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bbc19 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784725.720531:0:17866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185610c00/0xffb8d925c20bbc12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bbc19 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784725.720538:0:17866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff943185610c00/0xffb8d925c20bbc12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bbc19 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784725.720557:0:17866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787784725.720564:0:17866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bbdc4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbdcb expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784725.720571:0:17866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bbdc4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bbdcb expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784725.720578:0:17866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bbdc4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bbdcb expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784725.720584:0:17866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bbdc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bbdcb expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784725.720597:0:17866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787784725.720601:0:17866:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787784725.720625:0:17866:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787784725.720629:0:17866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787784725.720635:0:17866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787784725.720640:0:17866:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787784725.720645:0:17866:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9431885e19b8) has no exports 00000020:00080000:1.0:1787784725.720672:0:17866:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9431885e19b8) has no exports 00000020:01000000:1.0:1787784725.722471:0:17866:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff943081b871e0 - data ffff9431bfe471b0/ffff9431be905800 00000020:01000000:1.0:1787784725.722637:0:17866:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff943081b87900 - data ffff9431bfe3f288/ffff9431be8fbc00 00010000:00010000:2.0:1787784725.723018:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784725.723028:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943185610c00/0xffb8d925c20bbc12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bbc19 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784725.723039:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610c00 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:2.0:1787784725.723044:0:14404:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943185610c00/0xffb8d925c20bbc12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bbc19 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784725.723054:0:14404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943185610c00/0xffb8d925c20bbc12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20bbc19 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784725.723062:0:14404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943185610c00/0xffb8d925c20bbc12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20bbc19 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784725.723068:0:14404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787784725.723070:0:14404:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1787784725.723073:0:14404:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1787784725.723088:0:14404:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9431b9ffa000 00010000:00010000:2.0:1787784725.723092:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943185610c00/0xffb8d925c20bbc12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xffb8d925c20bbc19 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784725.723099:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943185610c00/0xffb8d925c20bbc12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xffb8d925c20bbc19 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784725.723123:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784725.723127:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bbdc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bbdcb expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784725.723133:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88800 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:2.0:1787784725.723136:0:14404:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bbdc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bbdcb expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784725.723143:0:14404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bbdc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20bbdcb expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784725.723150:0:14404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bbdc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20bbdcb expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784725.723155:0:14404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787784725.723158:0:14404:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787784725.723160:0:14404:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787784725.723166:0:14404:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9431b9ffa000 00010000:00010000:2.0:1787784725.723169:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bbdc4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xffb8d925c20bbdcb expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784725.723175:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bbdc4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xffb8d925c20bbdcb expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784725.723188:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784725.723189:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784725.723191:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784725.723624:0:17717:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1787784725.729245:0:17866:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787784725.762885:0:17866:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bbc27 00000020:00000080:3.0:1787784725.762897:0:17866:0:(genops.c:885:class_export_put()) final put ffff9431bf6ee000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787784725.762921:0:17866:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9431b3c6d800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787784725.762925:0:17866:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9431b3c6d800 2 00000020:01000004:3.0:1787784725.762928:0:17866:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9431b3c6d800 from lustre-OST0001 00000020:00000080:3.0:1787784725.762952:0:17866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784725.762961:0:17866:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787784725.762964:0:17866:0:(genops.c:885:class_export_put()) final put ffff9431bee30000/lustre-OST0001_UUID 00000020:00000080:3.0:1787784725.762966:0:17866:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bee30000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787784725.762972:0:17866:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1787784725.763198:0:17866:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 459db144-24ce-4979-944c-65e392f5ff2a->MGS 00010000:00010000:3.0:1787784725.763286:0:17866:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431bf500000/0xffb8d925c20bbad0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20bbad7 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784725.763300:0:17866:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431bf500000/0xffb8d925c20bbad0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20bbad7 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784725.763306:0:17866:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787784725.763308:0:17866:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787784725.763311:0:17866:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787784725.763325:0:17866:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9431b9ffa000 00010000:00010000:3.0:1787784725.763329:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431bf500000/0xffb8d925c20bbad0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xffb8d925c20bbad7 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784725.767719:0:17866:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943185610400/0xffb8d925c20bb9b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20bb9bf expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784725.767739:0:17866:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943185610400/0xffb8d925c20bb9b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20bb9bf expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784725.767746:0:17866:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787784725.767749:0:17866:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787784725.767753:0:17866:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787784725.767861:0:17866:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9431b9ffa000 00010000:00010000:3.0:1787784725.767865:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943185610400/0xffb8d925c20bb9b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xffb8d925c20bb9bf expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787784725.767979:0:17866:0:(import.c:65:import_set_state_nolock()) ffff9431b9ffa000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787784725.767985:0:17866:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787784725.767988:0:17866:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787784725.767990:0:17866:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000020:00000080:2.0:1787784725.768121:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bf6ee000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:3.0:1787784725.768178:0:17866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787784725.768190:0:17866:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9431962a6d00 x1874627643170688/t0(0) o250->MGC192.168.202.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787784732 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787784725.768349:0:17866:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787784725.768352:0:17866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:2.0:1787784725.768749:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:459db144-24ce-4979-944c-65e392f5ff2a:3292:1874627643170688:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:3.0:1787784725.768956:0:17866:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787784725.768967:0:17866:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bb9a3 00000020:00000080:3.0:1787784725.768974:0:17866:0:(genops.c:885:class_export_put()) final put ffff9431b9ffd800/459db144-24ce-4979-944c-65e392f5ff2a 00000020:01000000:3.0:1787784725.769004:0:17866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.159@tcp (flags='') 00000020:00000080:3.0:1787784725.769011:0:17866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784725.769019:0:17866:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.159@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787784725.769023:0:17866:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9431908f99b8) has no exports 10000000:01000000:3.0:1787784725.769039:0:14413:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787784725.769116:0:17866:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.159@tcp: client import never connected 00000100:00080000:3.0:1787784725.769119:0:17866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787784725.769122:0:17866:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787784725.769124:0:17866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787784725.769126:0:17866:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787784725.769161:0:17866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784725.769168:0:17866:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.159@tcp (uuid 459db144-24ce-4979-944c-65e392f5ff2a) 00000020:01000000:3.0:1787784725.769174:0:17866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787784725.769177:0:17866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784725.769182:0:17866:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787784725.769187:0:17866:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9431857d8000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787784725.769192:0:17866:0:(genops.c:1553:class_disconnect_exports()) OBD device 17 (ffff9431b6263370) has exports, disconnecting them 00000020:00080000:3.0:1787784725.769196:0:17866:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9431857d8000), last request at 1787784658 00000020:00000080:3.0:1787784725.769201:0:17866:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bbc51 00000020:00080000:3.0:1787784725.769212:0:17866:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9431857d8000): rc 0 00000020:00000080:3.0:1787784725.769216:0:17866:0:(genops.c:885:class_export_put()) final put ffff9431857d8000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787784725.769572:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b9ffd800/459db144-24ce-4979-944c-65e392f5ff2a for MGC192.168.202.159@tcp 00000020:00000080:0.0:1787784725.769583:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431857d8000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787784725.770831:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431b9ffa000 for MGC192.168.202.159@tcp 00000020:00000080:0.0:1787784725.770845:0:37:0:(genops.c:885:class_export_put()) final put ffff9431b9557800/459db144-24ce-4979-944c-65e392f5ff2a 00000020:00000080:0.0:1787784725.770848:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b9557800/459db144-24ce-4979-944c-65e392f5ff2a for MGC192.168.202.159@tcp 00000020:01000000:0.0:1787784725.770855:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.159@tcp (459db144-24ce-4979-944c-65e392f5ff2a) 00010000:01000000:2.0:1787784725.771456:0:17866:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787784725.771462:0:17866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787784725.771466:0:17866:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787784725.771472:0:17866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787784725.771565:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431857db800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1787784725.773433:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787784725.773666:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1787784725.773909:0:17717:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1787784725.774079:0:14400:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9431885d7400:14400] 1 exiting: rc = 0 00000100:00100000:2.0:1787784725.775494:0:14399:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9431885d6c00:14399] 0 exiting: rc = 1 00000100:00100000:0.0:1787784725.775639:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.775889:0:14403:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff943186857600:14403] 2 exiting: rc = 0 00000100:00100000:2.0:1787784725.776050:0:14402:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff943186857400:14402] 1 exiting: rc = 0 00000100:00100000:2.0:1787784725.776119:0:16535:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9431be898200:16535] 3 exiting: rc = 0 00000100:00100000:3.0:1787784725.796209:0:14401:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff943186856c00:14401] 0 exiting: rc = 1 00000100:00100000:0.0:1787784725.796586:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796606:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796613:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796621:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796629:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796635:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796641:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796646:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796651:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796656:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796662:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796667:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796671:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796676:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796681:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796698:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796703:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796709:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796714:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796719:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796725:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796730:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796736:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796741:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796746:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796751:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796757:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796762:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796767:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796783:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796788:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796794:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796799:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796804:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796809:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796814:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796819:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796824:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796829:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796834:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796839:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796845:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796850:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796855:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796861:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796866:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796871:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796876:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796881:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796886:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796898:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796903:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796908:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796914:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796919:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796924:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796929:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796934:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796939:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796944:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796949:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796954:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796959:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.796965:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787784725.798156:0:17866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784725.798165:0:17866:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787784725.798171:0:17866:0:(genops.c:885:class_export_put()) final put ffff9431857db000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787784725.798175:0:17866:0:(genops.c:844:class_export_destroy()) destroying export ffff9431857db000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787784725.798185:0:17866:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1787784725.798241:0:17866:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9431b3c6d800 1 00000020:00000080:0.0:1787784725.798248:0:17866:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bbc0b 00000020:00000080:0.0:1787784725.798255:0:17866:0:(genops.c:885:class_export_put()) final put ffff9431bf3ac800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787784725.798309:0:17866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787784725.798316:0:17866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787784725.798321:0:17866:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787784725.798324:0:17866:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9431b62619b8) has no exports 00000020:00000080:2.0:1787784725.798684:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bf3ac800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787784725.817061:0:17866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784725.817078:0:17866:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787784725.817083:0:17866:0:(genops.c:885:class_export_put()) final put ffff9431bf3a8000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787784725.817099:0:17866:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bf3a8000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787784725.817108:0:17866:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787784725.819949:0:17866:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9431b3c6a800 00000020:01000000:3.0:1787784725.819987:0:17866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787784725.819997:0:17866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784725.820002:0:17866:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787784725.820007:0:17866:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9431b9ecb370) has no exports 00000020:00000080:3.0:1787784725.820036:0:17866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784725.820045:0:17866:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787784725.820049:0:17866:0:(genops.c:885:class_export_put()) final put ffff9431bee7b800/OSS_uuid 00000020:00000080:3.0:1787784725.820052:0:17866:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bee7b800/OSS_uuid for OSS 00000020:01000000:3.0:1787784725.820057:0:17866:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1787784725.820177:0:14412:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787784725.821206:0:15099:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9431a55b9c00:15099] 0 exiting: rc = 1 00000100:00100000:3.0:1787784725.821545:0:15101:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9431a55b9600:15101] 1 exiting: rc = 0 00000100:00100000:3.0:1787784725.821625:0:16700:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9431bed8f000:16700] 3 exiting: rc = 0 00000100:00100000:2.0:1787784725.822050:0:15102:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff94318627c400:15102] 2 exiting: rc = 0 00000100:00100000:0.0:1787784725.822810:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822824:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822830:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822837:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822844:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822850:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822857:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822878:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822883:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822889:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822895:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822900:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822906:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822910:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822919:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822923:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822928:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822934:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822940:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822946:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822952:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822956:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822960:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822965:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822970:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822974:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822979:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822984:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822989:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.822994:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823014:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823021:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823026:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823031:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823037:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823041:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823046:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823051:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823055:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823060:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823066:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823071:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823084:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823089:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823094:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823099:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823103:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823108:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823116:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823121:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823126:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823131:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823136:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823141:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823146:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823151:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823156:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823161:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823166:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823172:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823176:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823182:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823187:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.823192:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.828636:0:15104:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9431884f6600:15104] 1 exiting: rc = 0 00000100:00100000:2.0:1787784725.829118:0:15103:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9431877ab600:15103] 0 exiting: rc = 1 00000100:00100000:3.0:1787784725.829271:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829278:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829283:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829288:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829294:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829299:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829304:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829308:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829314:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829319:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829323:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829328:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829333:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829348:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829355:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829360:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829392:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829398:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829403:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829422:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829427:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829432:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829437:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829443:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829448:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829453:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829458:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829463:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829468:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829472:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829477:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829485:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829489:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829494:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829499:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829503:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829508:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829514:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829519:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829523:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829528:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829534:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829539:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829545:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829551:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829556:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829561:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829570:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829575:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829581:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829586:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829600:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829607:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829612:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829625:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829631:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829636:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829641:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829646:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829652:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829657:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829662:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829667:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.829673:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.830884:0:16648:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9431b976d400:16648] 3 exiting: rc = 0 00000100:00100000:3.0:1787784725.831206:0:16649:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_004: service thread [ffff9431b624a200:16649] 4 exiting: rc = 0 00000100:00100000:2.0:1787784725.831569:0:15107:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff943186f14e00:15107] 2 exiting: rc = 0 00000100:00100000:3.0:1787784725.831739:0:16650:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_005: service thread [ffff9431b624ba00:16650] 5 exiting: rc = 0 00000100:00100000:3.0:1787784725.831966:0:15106:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff943186f15400:15106] 1 exiting: rc = 0 00000100:00100000:2.0:1787784725.832688:0:15105:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9431884d1400:15105] 0 exiting: rc = 1 00000100:00100000:0.0:1787784725.835267:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835281:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835288:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835294:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835300:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835307:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835313:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835319:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835328:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835344:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835351:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835356:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835404:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835410:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835415:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835420:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835425:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835431:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835437:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835443:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835448:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835470:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835477:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835482:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835488:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835493:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835498:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835502:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835508:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835513:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835518:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835523:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835527:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835532:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835537:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835542:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835547:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835551:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835556:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835561:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835565:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835570:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835575:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835580:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835585:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835900:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835908:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835922:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835928:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835933:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835938:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835943:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835949:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835956:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835962:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835968:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835972:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835977:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835982:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835988:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835994:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.835999:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.836004:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.836018:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.851316:0:15109:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff943186f15800:15109] 1 exiting: rc = 0 00000100:00100000:2.0:1787784725.851665:0:15108:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9431884f6e00:15108] 0 exiting: rc = 1 00000100:00100000:0.0:1787784725.852052:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852059:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852064:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852069:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852074:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852079:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852084:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852089:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852094:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852101:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852106:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852111:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852115:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852121:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852126:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852131:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852136:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852141:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852159:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852164:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852169:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852175:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852180:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852184:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852188:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852193:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852198:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852203:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852208:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852213:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852217:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852235:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852241:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852246:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852251:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852256:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852261:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852267:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852272:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852277:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852282:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852287:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852293:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852298:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852303:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852309:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852314:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852318:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852323:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852328:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852332:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852347:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852352:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852395:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852401:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852412:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852418:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852423:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852428:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852435:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852439:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852443:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852448:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.852453:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784725.856056:0:15110:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff943197018400:15110] 0 exiting: rc = 1 00000100:00100000:2.0:1787784725.858020:0:15111:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9431b9fb4e00:15111] 1 exiting: rc = 0 00000100:00100000:0.0:1787784725.858180:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858206:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858236:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858247:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858257:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858267:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858273:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858279:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858285:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858291:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858297:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858303:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858310:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858316:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858348:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858356:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858607:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858617:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858623:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858629:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858634:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858640:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858646:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858651:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858672:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858678:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858698:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858705:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858711:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858716:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858723:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858729:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858735:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858743:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858751:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858756:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858762:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858768:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858914:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858923:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858929:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858935:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858941:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858947:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858953:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858958:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858967:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858973:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858979:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.858985:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.859008:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.859015:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.859023:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.859031:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.859037:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.859043:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.859051:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.859057:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.859063:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.859084:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.859094:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.859114:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.859121:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784725.859134:0:17866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787784725.888950:0:17866:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1787784743.400349:0:18481:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787784753.515609:0:18941:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787784753.515614:0:18941:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787784753.515734:0:18941:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9430827c4800 00000020:01000004:0.0:1787784753.515751:0:18941:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1787784753.515759:0:18941:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787784753.515775:0:18941:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9431885e4d28) 00000020:00000080:0.0:1787784753.515790:0:18941:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787784753.532831:0:18941:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787784753.537738:0:18941:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:2.0:1787784753.538078:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1787784753.538280:0:18941:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787784753.538353:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1787784753.538652:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1787784753.538715:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1787784753.538800:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1787784753.538867:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1787784753.539128:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1787784753.543318:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 645: rc = 0 00100000:10000000:2.0:1787784753.543470:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 645: rc = 0 00100000:10000000:2.0:1787784753.543810:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 770: rc = 0 00100000:10000000:2.0:1787784753.544074:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 770: rc = 0 00100000:10000000:2.0:1787784753.544463:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 770: rc = 0 00100000:10000000:2.0:1787784753.544714:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 770: rc = 0 00100000:10000000:2.0:1787784753.544960:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 770: rc = 0 00100000:10000000:2.0:1787784753.545234:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 770: rc = 0 00100000:10000000:2.0:1787784753.545493:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 770: rc = 0 00100000:10000000:2.0:1787784753.545670:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 770: rc = 0 00100000:10000000:2.0:1787784753.545857:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 770: rc = 0 00100000:10000000:3.0:1787784753.547912:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 770: rc = 0 00100000:10000000:3.0:1787784753.548230:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 770: rc = 0 00100000:10000000:3.0:1787784753.548525:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 770: rc = 0 00100000:10000000:3.0:1787784753.548950:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 664: rc = 0 00100000:10000000:3.0:1787784753.549218:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 664: rc = 0 00100000:10000000:3.0:1787784753.549510:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 664: rc = 0 00100000:10000000:3.0:1787784753.549764:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 664: rc = 0 00100000:10000000:3.0:1787784753.550010:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 664: rc = 0 00100000:10000000:3.0:1787784753.550243:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 664: rc = 0 00100000:10000000:3.0:1787784753.550499:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 664: rc = 0 00100000:10000000:3.0:1787784753.550742:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 664: rc = 0 00100000:10000000:3.0:1787784753.557024:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 664: rc = 0 00100000:10000000:3.0:1787784753.558069:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 664: rc = 0 00100000:10000000:3.0:1787784753.558930:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 664: rc = 0 00100000:10000000:3.0:1787784753.559257:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 664: rc = 0 00100000:10000000:3.0:1787784753.566316:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 664: rc = 0 00100000:10000000:3.0:1787784753.569152:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 664: rc = 0 00100000:10000000:3.0:1787784753.569721:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 664: rc = 0 00100000:10000000:3.0:1787784753.572858:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 664: rc = 0 00100000:10000000:3.0:1787784753.574169:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 664: rc = 0 00100000:10000000:3.0:1787784753.575546:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 664: rc = 0 00100000:10000000:3.0:1787784753.575914:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 664: rc = 0 00100000:10000000:3.0:1787784753.576223:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 664: rc = 0 00100000:10000000:2.0:1787784753.580906:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 664: rc = 0 00100000:10000000:2.0:1787784753.581259:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 664: rc = 0 00100000:10000000:2.0:1787784753.582622:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 664: rc = 0 00100000:10000000:2.0:1787784753.583262:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 664: rc = 0 00100000:10000000:2.0:1787784753.584238:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 664: rc = 0 00100000:10000000:2.0:1787784753.584547:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 664: rc = 0 00100000:10000000:2.0:1787784753.584809:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 664: rc = 0 00100000:10000000:2.0:1787784753.585090:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 664: rc = 0 00100000:10000000:2.0:1787784753.585334:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 664: rc = 0 00100000:10000000:2.0:1787784753.589247:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 664: rc = 0 00100000:10000000:2.0:1787784753.593394:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 664: rc = 0 00100000:10000000:2.0:1787784753.593711:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 664: rc = 0 00100000:10000000:2.0:1787784753.594123:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 559: rc = 0 00100000:10000000:2.0:1787784753.595338:0:18941:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1787784753.595559:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 646: rc = 0 00100000:10000000:2.0:1787784753.597091:0:18941:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1787784753.597246:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 646: rc = 0 00100000:10000000:2.0:1787784753.597471:0:18941:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1787784753.597540:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 646: rc = 0 00100000:10000000:2.0:1787784753.599541:0:18941:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1787784753.599628:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 650: rc = 0 00100000:10000000:2.0:1787784753.601524:0:18941:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1787784753.601602:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 650: rc = 0 00100000:10000000:2.0:1787784753.603551:0:18941:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1787784753.603648:0:18941:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 650: rc = 0 00000020:00000080:2.0:1787784753.607695:0:18941:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787784753.607704:0:18941:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787784753.607716:0:18941:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xffb8d925c20bc079 00000020:01000004:2.0:1787784753.607723:0:18941:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787784753.607728:0:18941:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787784753.607732:0:18941:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9430827c4800 from MGS 00000020:01000004:2.0:1787784753.607736:0:18941:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787784753.607746:0:18941:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9431b9ecb370) 00000020:00000080:2.0:1787784753.607755:0:18941:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787784753.607803:0:18941:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9430827c4800 from MGS, refs=2 00080000:01000000:2.0:1787784753.607807:0:18941:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787784753.607811:0:18941:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xffb8d925c20bc087 00000100:00100000:2.0:1787784753.609548:0:18941:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787784753.609857:0:18941:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787784753.609864:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787784753.610811:0:18941:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787784753.610820:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787784753.614842:0:18941:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787784753.616075:0:18941:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787784753.616087:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787784753.622827:0:18941:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787784753.622840:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787784753.628011:0:18941:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787784753.628026:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787784753.629673:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784753.629677:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784753.629679:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784753.630129:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784753.630132:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784753.630141:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784753.630767:0:18941:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787784753.632603:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787784753.651839:0:18941:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787784753.651852:0:18941:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787784753.651854:0:18941:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787784753.659450:0:18950:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787784753.668063:0:18941:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787784753.668219:0:18941:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787784753.668771:0:18941:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787784753.669103:0:18941:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784753.669275:0:18941:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787784753.669280:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787784753.670511:0:18941:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787784753.670581:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787784753.673516:0:18941:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787784753.673532:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787784753.674724:0:18941:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787784753.674749:0:18941:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.159@tcp' 00000020:01000004:0.0:1787784753.674751:0:18941:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787784753.674784:0:18941:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.159@tcp (typ=mgc) 00000020:00000080:0.0:1787784753.674796:0:18941:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.159@tcp (ffff9431885e3370) 00000020:00000080:0.0:1787784753.674811:0:18941:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787784753.674904:0:18941:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9430827c2000@MGC192.168.202.159@tcp: add connection 192.168.202.159@tcp at head 00010000:00010000:0.0:1787784753.675101:0:18941:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.159@tcp-0 is initialized 00000040:01000000:0.0:1787784753.675107:0:18941:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.159@tcp ctxt 1 is initialized 10000000:01000000:0.0:1787784753.677568:0:18956:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787784753.677672:0:18941:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.159@tcp (uuid 17693f43-cfcf-4d1e-8495-73723b171a31) 00000020:00000080:3.0:1787784753.677696:0:18941:0:(genops.c:1385:class_connect()) connect: client 17693f43-cfcf-4d1e-8495-73723b171a31, cookie 0xffb8d925c20bc095 00000100:00080000:3.0:1787784753.677711:0:18941:0:(import.c:510:import_select_connection()) MGC192.168.202.159@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787784753.677718:0:18941:0:(import.c:624:import_select_connection()) MGC192.168.202.159@tcp: import ffff9430827c2000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:3.0:1787784753.677752:0:18941:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431962a43c0 x1874627643170944/t0(0) o250->MGC192.168.202.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787784753.677781:0:18941:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 17693f43-cfcf-4d1e-8495-73723b171a31->MGS 00000020:01000004:3.0:1787784753.677820:0:18941:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787784753.677825:0:18941:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787784753.677838:0:18941:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9431908f99b8) 00000020:00000080:3.0:1787784753.677850:0:18941:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787784753.678066:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:17693f43-cfcf-4d1e-8495-73723b171a31:3292:1874627643170944:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787784753.678135:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784753.678203:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643170944 00000100:00100000:0.0:1787784753.678215:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643170944 00000100:00100000:0.0:1787784753.678245:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784753.678252:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3292:x1874627643170944:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787784753.678274:0:18952:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 17693f43-cfcf-4d1e-8495-73723b171a31@0@lo t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:0.0:1787784753.678294:0:18952:0:(genops.c:1385:class_connect()) connect: client 17693f43-cfcf-4d1e-8495-73723b171a31, cookie 0xffb8d925c20bc0a3 00000100:00080000:0.0:1787784753.678464:0:18952:0:(import.c:65:import_set_state_nolock()) ffff9430827c3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784753.678513:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+5:3292:x1874627643170944:12345-0@lo:250:mount.lustre.0 Request processed in 260us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784753.678520:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784753.678552:0:3292:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.159@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787784753.678560:0:3292:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.159@tcp: connect to target with instance 0 00000100:00080000:0.0:1787784753.678566:0:3292:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.159@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787784753.678570:0:3292:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787784753.678573:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9430827c2000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787784753.678576:0:3292:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787784753.678583:0:3292:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787784753.678587:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:17693f43-cfcf-4d1e-8495-73723b171a31:3292:1874627643170944:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1787784753.683624:0:18955:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1787784753.705923:0:18941:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784753.707287:0:18941:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787784753.707298:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787784753.708767:0:18941:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787784753.708779:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787784753.709539:0:18941:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787784753.709547:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787784753.710630:0:18941:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784753.710865:0:18941:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787784753.710870:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787784753.724784:0:18941:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787784753.724796:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787784753.792084:0:18941:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784753.792304:0:18941:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787784753.792310:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787784753.795539:0:18941:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787784753.795553:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787784753.796020:0:18941:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784753.796195:0:18941:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787784753.796199:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787784753.797556:0:18941:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787784753.797565:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787784753.798292:0:18941:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784753.798622:0:18941:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787784753.798629:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787784753.799357:0:18941:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787784753.806143:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787784753.807593:0:18941:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784753.807780:0:18941:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787784753.807786:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787784753.817314:0:18941:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787784753.817522:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787784753.875959:0:18941:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784753.876160:0:18941:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787784753.876167:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787784753.890056:0:18941:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787784753.890071:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787784753.891992:0:18941:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787784753.892009:0:18941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787784753.896189:0:18941:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787784753.896230:0:18941:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787784753.896237:0:18941:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.159@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787784753.896583:0:18941:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.159@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787784753.896623:0:18941:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.159@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787784753.896628:0:18941:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787784753.896630:0:18941:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787784753.896631:0:18941:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784753.896637:0:18941:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784753.896638:0:18941:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784753.896639:0:18941:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784753.896640:0:18941:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787784753.896642:0:18941:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787784753.896643:0:18941:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784753.896645:0:18941:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787784753.896647:0:18941:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787784753.896649:0:18941:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787784753.896650:0:18941:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787784753.896651:0:18941:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784753.896652:0:18941:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784753.896653:0:18941:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784753.896654:0:18941:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784753.896655:0:18941:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787784753.896656:0:18941:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787784753.896657:0:18941:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784753.896657:0:18941:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787784753.896683:0:18941:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787784753.896700:0:18941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ad680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643171072:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787784753.896783:0:18941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784753.896826:0:18941:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784753.902603:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643171072 00000100:00100000:2.0:1787784753.902618:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643171072 00000100:00100000:2.0:1787784753.902674:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784753.902684:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+5:18941:x1874627643171072:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787784753.903021:0:18954:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787784753.903024:0:18954:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787784753.903027:0:18954:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787784753.905390:0:18975:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787784753.908952:0:18954:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:3.0:1787784753.910306:0:18976:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787784753.910313:0:18976:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787784753.910315:0:18976:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787784753.910348:0:18976:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1787784753.910727:0:18954:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787784753.910739:0:18954:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787784753.926215:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+5:18941:x1874627643171072:12345-0@lo:253:mount.lustre.0 Request processed in 23526us (29425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784753.926236:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784753.926413:0:18941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ad680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643171072:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787784753.926430:0:18941:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787784753.926433:0:18941:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787784753.926435:0:18941:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787784753.926436:0:18941:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784753.926438:0:18941:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784753.926439:0:18941:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784753.926440:0:18941:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784753.926442:0:18941:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787784753.926443:0:18941:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787784753.926445:0:18941:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784753.926446:0:18941:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787784753.926467:0:18941:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9430827c4800 from lustre-MDT0000 10000000:01000000:0.0:1787784753.926495:0:18941:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787784753.926497:0:18941:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787784753.926526:0:18941:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9431885e3370 10000000:01000000:0.0:1787784753.926531:0:18941:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787784753.926538:0:18941:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9431885e3370 from 1 10000000:01000000:0.0:1787784753.926540:0:18941:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787784753.926576:0:18941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bee89c00/0xffb8d925c20bc0aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784753.926586:0:18941:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bee89c00/0xffb8d925c20bc0aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784753.926596:0:18941:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bee89c00/0xffb8d925c20bc0aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784753.926614:0:18941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ad680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643171200:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787784753.926648:0:18941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784753.926682:0:18941:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784753.926803:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643171200 00000100:00100000:3.0:1787784753.926809:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643171200 00000100:00100000:3.0:1787784753.926860:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787784753.926869:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+5:18941:x1874627643171200:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784753.926883:0:18952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784753.926898:0:18952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf500000/0xffb8d925c20bc0b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bc0aa expref: -99 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784753.926920:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf500000/0xffb8d925c20bc0b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bc0aa expref: 6 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784753.926931:0:18952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf500000/0xffb8d925c20bc0b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc0aa expref: 6 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784753.926940:0:18952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500000, rc 0) 00000100:00100000:3.0:1787784753.926988:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+6:18941:x1874627643171200:12345-0@lo:101:mount.lustre.0 Request processed in 121us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784753.926995:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784753.927145:0:18941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ad680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643171200:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784753.927158:0:18941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bee89c00/0xffb8d925c20bc0aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc0b1 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784753.927167:0:18941:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bee89c00/0xffb8d925c20bc0aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bc0b1 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784753.927213:0:18941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643171328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784753.927248:0:18941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784753.927276:0:18941:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318858f540 going to sleep for 11 seconds 00000100:00100000:3.0:1787784753.927391:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643171328 00000100:00100000:3.0:1787784753.927396:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643171328 00000100:00100000:3.0:1787784753.927423:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787784753.927430:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+6:18941:x1874627643171328:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784753.927660:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+6:18941:x1874627643171328:12345-0@lo:501:mount.lustre.0 Request processed in 229us (410us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787784753.927667:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784753.927830:0:18941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643171328:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787784753.927853:0:18941:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787784753.927870:0:18941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bee89c00/0xffb8d925c20bc0aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc0b1 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784753.927878:0:18941:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bee89c00/0xffb8d925c20bc0aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc0b1 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784753.927886:0:18941:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9430827c4800 10000000:01000000:2.0:1787784753.927890:0:18941:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787784753.927894:0:18941:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9430827c4800 10000000:01000000:2.0:1787784753.927896:0:18941:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787784753.927899:0:18941:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9430827c4800 from 1 10000000:01000000:2.0:1787784753.927901:0:18941:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787784753.927918:0:18941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1200/0xffb8d925c20bc0b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784753.927925:0:18941:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1200/0xffb8d925c20bc0b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784753.927932:0:18941:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1200/0xffb8d925c20bc0b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784753.927945:0:18941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643171456:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787784753.927998:0:18941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784753.928027:0:18941:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318858f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787784753.928088:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643171456 00000100:00100000:1.0:1787784753.928092:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643171456 00000100:00100000:1.0:1787784753.928121:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787784753.928127:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+6:18941:x1874627643171456:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784753.928143:0:18953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784753.928154:0:18953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943181512000/0xffb8d925c20bc0bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bc0b8 expref: -99 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784753.928167:0:18953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943181512000/0xffb8d925c20bc0bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bc0b8 expref: 7 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784753.928175:0:18953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943181512000/0xffb8d925c20bc0bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc0b8 expref: 7 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784753.928181:0:18953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943181512000, rc 0) 00000100:00100000:1.0:1787784753.928215:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+7:18941:x1874627643171456:12345-0@lo:101:mount.lustre.0 Request processed in 88us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784753.928229:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787784753.928403:0:18941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643171456:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784753.928420:0:18941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1200/0xffb8d925c20bc0b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc0bf expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784753.928427:0:18941:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1200/0xffb8d925c20bc0b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bc0bf expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784753.928438:0:18941:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787784753.928447:0:18941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1200/0xffb8d925c20bc0b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc0bf expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784753.928455:0:18941:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1200/0xffb8d925c20bc0b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc0bf expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784753.928461:0:18941:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787784753.928464:0:18941:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787784753.928468:0:18941:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9430827c4800 10000000:01000000:2.0:1787784753.928470:0:18941:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787784753.928472:0:18941:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787784753.928474:0:18941:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787784753.928487:0:18941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0c00/0xffb8d925c20bc0c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784753.928493:0:18941:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0c00/0xffb8d925c20bc0c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784753.928500:0:18941:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0c00/0xffb8d925c20bc0c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784753.928511:0:18941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643171584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787784753.928553:0:18941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784753.928577:0:18941:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318858f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787784753.928710:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643171584 00000100:00100000:1.0:1787784753.928715:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643171584 00000100:00100000:1.0:1787784753.928746:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784753.928752:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+7:18941:x1874627643171584:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784753.928759:0:18952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784753.928767:0:18952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943181513200/0xffb8d925c20bc0cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bc0c6 expref: -99 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784753.928780:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943181513200/0xffb8d925c20bc0cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bc0c6 expref: 8 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784753.928788:0:18952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943181513200/0xffb8d925c20bc0cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc0c6 expref: 8 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784753.928794:0:18952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943181513200, rc 0) 00000100:00100000:1.0:1787784753.928826:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+8:18941:x1874627643171584:12345-0@lo:101:mount.lustre.0 Request processed in 75us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784753.928831:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787784753.930930:0:18941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643171584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784753.930959:0:18941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0c00/0xffb8d925c20bc0c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc0cd expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784753.930978:0:18941:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0c00/0xffb8d925c20bc0c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bc0cd expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784753.931062:0:18941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643171712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784753.931114:0:18941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784753.931163:0:18941:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318858f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787784753.931289:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643171712 00000100:00100000:1.0:1787784753.931295:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643171712 00000100:00100000:1.0:1787784753.931342:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787784753.931353:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+8:18941:x1874627643171712:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784753.931802:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+9:18941:x1874627643171712:12345-0@lo:501:mount.lustre.0 Request processed in 451us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784753.931810:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787784753.932131:0:18941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643171712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784753.932174:0:18941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643171840:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787784753.932214:0:18941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784753.932240:0:18941:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318858f540 going to sleep for 11 seconds 00000100:00100000:3.0:1787784753.932337:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643171840 00000100:00100000:3.0:1787784753.932342:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643171840 00000100:00100000:3.0:1787784753.932394:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787784753.932403:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3899450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+9:18941:x1874627643171840:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787784753.932724:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3899450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+9:18941:x1874627643171840:12345-0@lo:503:mount.lustre.0 Request processed in 322us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784753.932739:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787784753.932982:0:18941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643171840:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787784753.933447:0:18977:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17693f43-cfcf-4d1e-8495-73723b171a31:18977:1874627643171968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784753.933491:0:18977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784753.933535:0:18977:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318858f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787784753.933639:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643171968 00000100:00100000:0.0:1787784753.933644:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643171968 00000100:00100000:0.0:1787784753.933678:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787784753.933686:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3899050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+9:18977:x1874627643171968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784753.933949:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3899050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+9:18977:x1874627643171968:12345-0@lo:502:llog_process_th.0 Request processed in 262us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784753.933956:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787784753.934673:0:18977:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17693f43-cfcf-4d1e-8495-73723b171a31:18977:1874627643171968:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787784753.934721:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784753.934733:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784753.934736:0:18977:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787784753.934741:0:18977:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787784753.934752:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787784753.934767:0:18977:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9431b9eccd28) 00000020:00000080:2.0:1787784753.934787:0:18977:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787784753.934793:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787784753.934877:0:18977:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787784753.934885:0:18977:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xffb8d925c20bc0db 00000020:00000080:2.0:1787784753.935111:0:18977:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787784753.935116:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784753.935119:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784753.935121:0:18977:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787784753.935124:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784753.935127:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784753.935128:0:18977:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787784753.935496:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787784753.935506:0:18977:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9431b9ec99b8) 00000020:00000080:2.0:1787784753.935604:0:18977:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787784753.935612:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787784753.935614:0:18977:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787784753.935616:0:18977:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787784753.935622:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787784753.935679:0:18977:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9430827c4800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787784753.935693:0:18977:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9431b9ec8000) 00000020:00000080:2.0:1787784753.935700:0:18977:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787784753.936665:0:18977:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787784753.936674:0:18977:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xffb8d925c20bc0f0 00000020:00000080:2.0:1787784753.937110:0:18977:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787784753.937118:0:18977:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787784753.937123:0:18977:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xffb8d925c20bc0f7 00080000:01000000:2.0:1787784753.937130:0:18977:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787784753.937329:0:18977:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xffb8d925c20bc0fe 00010000:00010000:2.0:1787784754.069837:0:18977:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787784754.071414:0:18977:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:3.0:1787784754.072838:0:18977:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787784754.075490:0:18977:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9431908fcd28) 00000020:00000080:3.0:1787784754.075514:0:18977:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787784754.075602:0:18977:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787784754.075610:0:18977:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xffb8d925c20bc10c 00000020:00000080:0.0:1787784754.091580:0:18977:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787784754.105674:0:18977:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xffb8d925c20bc113 00000020:00000080:1.0:1787784754.109084:0:18977:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787784754.109107:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784754.109113:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784754.109116:0:18977:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787784754.109119:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784754.109126:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784754.109136:0:18977:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787784754.109142:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787784754.109189:0:18977:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787784754.109209:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784754.109211:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784754.109213:0:18977:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787784754.109215:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787784754.109217:0:18977:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1787784754.109218:0:18977:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787784754.109220:0:18977:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787784754.109221:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787784754.109223:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784754.109224:0:18977:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787784754.109227:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787784754.109230:0:18977:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787784754.109233:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784754.109235:0:18977:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787784754.109238:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787784754.109243:0:18977:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.159@tcp to nid 0x20000c0a8ca9f (192.168.202.159@tcp) 00000020:01000000:1.0:1787784754.109270:0:18977:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787784754.109274:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787784754.109290:0:18977:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9431b6264d28) 00000020:00000080:1.0:1787784754.109304:0:18977:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787784754.109309:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787784754.109386:0:18977:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787784754.109393:0:18977:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787784754.109399:0:18977:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xffb8d925c20bc121 00010000:00080000:1.0:1787784754.109431:0:18977:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9431bed64000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.159@tcp at head 00010000:00010000:1.0:1787784754.109690:0:18977:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1787784754.110344:0:18977:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787784754.110414:0:18977:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787784754.115693:0:18977:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787784754.116030:0:18977:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1787784754.116767:0:18977:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1787784754.120806:0:18981:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787784754.120817:0:18981:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787784754.128259:0:18977:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787784754.128274:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787784754.128313:0:18977:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787784754.128331:0:18977:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xffb8d925c20bc128 00000100:00080000:0.0:1787784754.128361:0:18977:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787784754.128399:0:18977:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9431bed64000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:0.0:1787784754.128434:0:18977:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431b45af0c0 x1874627643172096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784754.128466:0:18977:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787784754.128712:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784754.128718:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784754.128720:0:18977:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787784754.128723:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787784754.128726:0:18977:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787784754.128727:0:18977:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787784754.128728:0:18977:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787784754.128730:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787784754.128732:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784754.128733:0:18977:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787784754.128735:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787784754.128739:0:18977:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787784754.128743:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784754.128744:0:18977:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787784754.128747:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787784754.128750:0:18977:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.159@tcp to nid 0x20000c0a8ca9f (192.168.202.159@tcp) 00000020:01000000:0.0:1787784754.128773:0:18977:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787784754.128776:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787784754.128788:0:18977:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9431885e19b8) 00000020:00000080:0.0:1787784754.128800:0:18977:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787784754.128804:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787784754.128877:0:18977:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787784754.128885:0:18977:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787784754.128891:0:18977:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xffb8d925c20bc136 00010000:00080000:0.0:1787784754.128921:0:18977:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9431b5c4d800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.159@tcp at head 00000100:00100000:2.0:1787784754.129492:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643172096:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787784754.129561:0:3292:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627643172096 offset 0 length 520: 4 00010000:00010000:1.0:1787784754.129885:0:18977:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1787784754.130096:0:18977:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787784754.130116:0:18977:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787784754.130925:0:18977:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787784754.131050:0:18977:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1787784754.131127:0:18977:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1787784754.133415:0:18983:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1787784754.133422:0:18983:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787784754.140408:0:18977:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787784754.140425:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787784754.140469:0:18977:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787784754.140492:0:18977:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xffb8d925c20bc13d 00000100:00080000:2.0:1787784754.140504:0:18977:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787784754.140510:0:18977:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9431b5c4d800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:2.0:1787784754.141647:0:18977:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431b45b5a40 x1874627643172224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787784754.141740:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643172224:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787784754.141829:0:3292:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627643172224 offset 0 length 520: 4 00000100:00080000:2.0:1787784754.142023:0:18977:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787784754.142107:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784754.142114:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784754.142116:0:18977:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787784754.142119:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784754.142123:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784754.142124:0:18977:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787784754.142127:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787784754.142129:0:18977:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787784754.142131:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784754.142134:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784754.142135:0:18977:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787784754.142138:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784754.142140:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784754.142141:0:18977:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787784754.142145:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787784754.142177:0:18977:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17693f43-cfcf-4d1e-8495-73723b171a31:18977:1874627643172352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784754.142225:0:18977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784754.142246:0:18977:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318858f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787784754.148291:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643172352 00000100:00100000:2.0:1787784754.148307:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643172352 00000100:00100000:3.0:1787784754.148471:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787784754.148486:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3898050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+9:18977:x1874627643172352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784754.148814:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3898050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+9:18977:x1874627643172352:12345-0@lo:502:llog_process_th.0 Request processed in 332us (6588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784754.148822:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787784754.148958:0:18977:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17693f43-cfcf-4d1e-8495-73723b171a31:18977:1874627643172352:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787784754.149019:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784754.149027:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784754.149030:0:18977:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787784754.149034:0:18977:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787784754.149670:0:18941:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1787784754.149691:0:18941:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787784754.149724:0:18941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0c00/0xffb8d925c20bc0c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc0cd expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784754.149735:0:18941:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0c00/0xffb8d925c20bc0c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc0cd expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784754.149742:0:18941:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9430827c4800 from 1 10000000:01000000:1.0:1787784754.149745:0:18941:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787784754.149781:0:18941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20bc144 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784754.149798:0:18941:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20bc144 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784754.149807:0:18941:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20bc144 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784754.149827:0:18941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643172480:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787784754.150146:0:18941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784754.150184:0:18941:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318613d240 going to sleep for 11 seconds 00000100:00100000:2.0:1787784754.150353:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643172480 00000100:00100000:2.0:1787784754.150359:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643172480 00000100:00100000:2.0:1787784754.150436:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787784754.150444:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+9:18941:x1874627643172480:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784754.150456:0:18952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784754.150470:0:18952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf7f0200/0xffb8d925c20bc14b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bc144 expref: -99 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784754.150493:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf7f0200/0xffb8d925c20bc14b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bc144 expref: 10 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784754.150504:0:18952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf7f0200/0xffb8d925c20bc14b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc144 expref: 10 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784754.150512:0:18952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf7f0200, rc 0) 00000100:00100000:2.0:1787784754.150561:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+10:18941:x1874627643172480:12345-0@lo:101:mount.lustre.0 Request processed in 117us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784754.150568:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787784754.151045:0:18941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643172480:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784754.151062:0:18941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20bc144 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc14b expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784754.151072:0:18941:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20bc144 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bc14b expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784754.152164:0:18941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643172608:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787784754.152223:0:18941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784754.152266:0:18941:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318613d240 going to sleep for 11 seconds 00000100:00100000:2.0:1787784754.152498:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643172608 00000100:00100000:2.0:1787784754.152505:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643172608 00000100:00100000:2.0:1787784754.152552:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784754.152560:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3898450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+10:18941:x1874627643172608:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787784754.152579:0:18953:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787784754.152586:0:18953:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787784754.152655:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3898450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+10:18941:x1874627643172608:12345-0@lo:256:mount.lustre.0 Request processed in 95us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784754.152663:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787784754.152785:0:18941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643172608:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787784754.153506:0:18941:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787784754.153524:0:18941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20bc144 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc14b expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784754.153535:0:18941:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20bc144 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc14b expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784754.153559:0:18941:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9430827c4800 from 1 10000000:01000000:1.0:1787784754.153562:0:18941:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787784754.153594:0:18941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20bc152 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784754.153602:0:18941:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20bc152 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784754.153611:0:18941:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20bc152 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784754.153628:0:18941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643172736:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787784754.153666:0:18941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784754.154408:0:18941:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318613d240 going to sleep for 11 seconds 00000100:00100000:3.0:1787784754.154460:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643172736 00000100:00100000:3.0:1787784754.154466:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643172736 00000100:00100000:3.0:1787784754.154693:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787784754.154704:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3899850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+10:18941:x1874627643172736:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784754.154733:0:18954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784754.154749:0:18954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf500a00/0xffb8d925c20bc159 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bc152 expref: -99 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784754.154773:0:18954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf500a00/0xffb8d925c20bc159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bc152 expref: 11 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784754.154785:0:18954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf500a00/0xffb8d925c20bc159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc152 expref: 11 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784754.154811:0:18954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500a00, rc 0) 00000100:00100000:3.0:1787784754.155128:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3899850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+11:18941:x1874627643172736:12345-0@lo:101:mount.lustre.0 Request processed in 427us (1461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784754.155135:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787784754.155212:0:18941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643172736:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784754.155229:0:18941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20bc152 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc159 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784754.155238:0:18941:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20bc152 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bc159 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784754.155306:0:18941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643172864:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784754.155337:0:18941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784754.155476:0:18941:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318613d240 going to sleep for 11 seconds 00000100:00100000:2.0:1787784754.155550:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643172864 00000100:00100000:2.0:1787784754.155554:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643172864 00000100:00100000:2.0:1787784754.155578:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787784754.155584:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+11:18941:x1874627643172864:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784754.156317:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+11:18941:x1874627643172864:12345-0@lo:501:mount.lustre.0 Request processed in 731us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784754.156325:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787784754.156451:0:18941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643172864:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784754.156491:0:18941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643172992:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784754.156543:0:18941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784754.156561:0:18941:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318613d240 going to sleep for 11 seconds 00000100:00100000:2.0:1787784754.156654:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643172992 00000100:00100000:2.0:1787784754.156659:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643172992 00000100:00100000:2.0:1787784754.156680:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787784754.156686:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+11:18941:x1874627643172992:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787784754.157155:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+11:18941:x1874627643172992:12345-0@lo:503:mount.lustre.0 Request processed in 467us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784754.157162:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787784754.157468:0:18941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643172992:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787784754.158079:0:18985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17693f43-cfcf-4d1e-8495-73723b171a31:18985:1874627643173120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784754.158125:0:18985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784754.158202:0:18985:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318690ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787784754.158241:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643173120 00000100:00100000:0.0:1787784754.158246:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643173120 00000100:00100000:0.0:1787784754.158285:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787784754.158292:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+11:18985:x1874627643173120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784754.158958:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+11:18985:x1874627643173120:12345-0@lo:502:llog_process_th.0 Request processed in 664us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784754.158976:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787784754.159133:0:18985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17693f43-cfcf-4d1e-8495-73723b171a31:18985:1874627643173120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787784754.159164:0:18985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784754.159173:0:18985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784754.159176:0:18985:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787784754.159183:0:18985:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9430827c4800 00000020:00000080:3.0:1787784754.159186:0:18985:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787784754.159195:0:18985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784754.159197:0:18985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784754.159199:0:18985:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787784754.159201:0:18985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784754.159204:0:18985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784754.159206:0:18985:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787784754.159209:0:18985:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9430827c4800 00000020:00000080:3.0:1787784754.159212:0:18985:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787784754.159275:0:18985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784754.159279:0:18985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784754.159280:0:18985:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787784754.159283:0:18985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784754.159285:0:18985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784754.159286:0:18985:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787784754.159289:0:18985:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9430827c4800 00000020:00000080:3.0:1787784754.159291:0:18985:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787784754.159333:0:18985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17693f43-cfcf-4d1e-8495-73723b171a31:18985:1874627643173248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784754.159403:0:18985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784754.159437:0:18985:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431843a33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784754.160916:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643173248 00000100:00100000:1.0:1787784754.160927:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643173248 00000100:00100000:1.0:1787784754.161055:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787784754.161064:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+11:18985:x1874627643173248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784754.161329:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+11:18985:x1874627643173248:12345-0@lo:502:llog_process_th.0 Request processed in 264us (1924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784754.161337:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787784754.161478:0:18985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17693f43-cfcf-4d1e-8495-73723b171a31:18985:1874627643173248:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787784754.161513:0:18985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784754.161519:0:18985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784754.161522:0:18985:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787784754.161526:0:18985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787784754.161837:0:18941:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787784754.162024:0:18941:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787784754.162046:0:18941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20bc152 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc159 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784754.162056:0:18941:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20bc152 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc159 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784754.162097:0:18941:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787784754.162100:0:18941:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9430827c4800 10000000:01000000:1.0:1787784754.162102:0:18941:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9430827c4800 10000000:01000000:1.0:1787784754.162106:0:18941:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787784754.162111:0:18941:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9430827c4800 from 1 10000000:01000000:1.0:1787784754.162114:0:18941:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787784754.162140:0:18941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20bc160 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784754.162154:0:18941:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20bc160 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784754.162164:0:18941:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20bc160 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784754.162181:0:18941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643173376:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787784754.162218:0:18941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784754.162247:0:18941:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318613d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784754.162265:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643173376 00000100:00100000:1.0:1787784754.162269:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643173376 00000100:00100000:1.0:1787784754.162296:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787784754.162302:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+11:18941:x1874627643173376:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784754.162311:0:18953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784754.162324:0:18953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943181513e00/0xffb8d925c20bc167 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bc160 expref: -99 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784754.162345:0:18953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943181513e00/0xffb8d925c20bc167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bc160 expref: 12 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784754.162355:0:18953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943181513e00/0xffb8d925c20bc167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc160 expref: 12 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784754.162389:0:18953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943181513e00, rc 0) 00000100:00100000:1.0:1787784754.162421:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+12:18941:x1874627643173376:12345-0@lo:101:mount.lustre.0 Request processed in 120us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784754.162427:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787784754.162484:0:18941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643173376:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784754.162497:0:18941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20bc160 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc167 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784754.162506:0:18941:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20bc160 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bc167 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784754.162559:0:18941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643173504:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784754.162583:0:18941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784754.162599:0:18941:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318613d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784754.163904:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643173504 00000100:00100000:3.0:1787784754.163914:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643173504 00000100:00100000:3.0:1787784754.164081:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787784754.164091:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3898c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+12:18941:x1874627643173504:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784754.164420:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3898c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+12:18941:x1874627643173504:12345-0@lo:501:mount.lustre.0 Request processed in 330us (1835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784754.164428:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787784754.164605:0:18941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643173504:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784754.164652:0:18941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643173632:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787784754.164696:0:18941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784754.169180:0:18941:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318690ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1787784754.169336:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643173632 00000100:00100000:1.0:1787784754.169348:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643173632 00000100:00100000:1.0:1787784754.169448:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787784754.169458:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3898850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+12:18941:x1874627643173632:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784754.169700:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3898850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+12:18941:x1874627643173632:12345-0@lo:503:mount.lustre.0 Request processed in 243us (5003us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784754.169710:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787784754.171288:0:18941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643173632:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787784754.171780:0:18987:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17693f43-cfcf-4d1e-8495-73723b171a31:18987:1874627643173760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784754.171858:0:18987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784754.171897:0:18987:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318690ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784754.172435:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643173760 00000100:00100000:1.0:1787784754.172442:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643173760 00000100:00100000:1.0:1787784754.172485:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787784754.172494:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3899c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+12:18987:x1874627643173760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784754.172745:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3899c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+12:18987:x1874627643173760:12345-0@lo:502:llog_process_th.0 Request processed in 252us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784754.172753:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787784754.173086:0:18987:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17693f43-cfcf-4d1e-8495-73723b171a31:18987:1874627643173760:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787784754.173142:0:18987:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787784754.173162:0:18987:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9431857e3370) 00000020:00000080:2.0:1787784754.173181:0:18987:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1787784754.173345:0:18987:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9430827c4800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787784754.173350:0:18987:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9430827c4800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787784754.173353:0:18987:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9430827c4800 4 00010000:00080000:2.0:1787784754.173413:0:18987:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9431904c0000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.159@tcp at head 00010000:00010000:2.0:1787784754.214907:0:18987:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1787784754.215734:0:18987:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787784754.215772:0:18987:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787784754.215786:0:18987:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xffb8d925c20bc175 00000100:00080000:2.0:1787784754.215797:0:18987:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787784754.215803:0:18987:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9431904c0000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:2.0:1787784754.215837:0:18987:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431b45b52c0 x1874627643173888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787784754.218105:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874627643173888:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787784754.218177:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784754.219077:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643173888 00000100:00100000:2.0:1787784754.219089:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643173888 00000100:00100000:2.0:1787784754.219135:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787784754.219143:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3292:x1874627643173888:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787784754.220322:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3292:x1874627643173888:12345-0@lo:38:llog_process_th.0 Request processed in 1173us (2138us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787784754.220333:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787784754.220395:0:3292:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787784754.220404:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431904c0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784754.220421:0:3292:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787784754.220425:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874627643173888:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787784754.220495:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784754.220500:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784754.220503:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784754.220505:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787784754.222315:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17693f43-cfcf-4d1e-8495-73723b171a31:3295:1874627643174016:0@lo:400:kworker.0 00000100:00100000:2.0:1787784754.222416:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784754.222488:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643174016 00000100:00100000:2.0:1787784754.222496:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643174016 00000100:00100000:2.0:1787784754.225622:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787784754.225642:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+12:3295:x1874627643174016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784754.225744:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+12:3295:x1874627643174016:12345-0@lo:400:kworker.0 Request processed in 110us (3327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784754.225752:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787784754.227717:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17693f43-cfcf-4d1e-8495-73723b171a31:3295:1874627643174016:0@lo:400:kworker.0 00000100:00080000:2.0:1787784754.227752:0:18987:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787784754.227777:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784754.227781:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784754.227784:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784754.227787:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787784754.228739:0:18987:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17693f43-cfcf-4d1e-8495-73723b171a31:18987:1874627643174144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784754.228815:0:18987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784754.229633:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643174144 00000100:00100000:3.0:1787784754.229643:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643174144 00000100:00100000:3.0:1787784754.229689:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787784754.229698:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+12:18987:x1874627643174144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784754.230321:0:18987:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318690e900 going to sleep for 11 seconds 00000100:00100000:3.0:1787784754.232337:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+12:18987:x1874627643174144:12345-0@lo:502:llog_process_th.0 Request processed in 2633us (3515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784754.232350:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787784754.232453:0:18987:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17693f43-cfcf-4d1e-8495-73723b171a31:18987:1874627643174144:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787784754.232488:0:18987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787784754.232759:0:18941:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787784754.232781:0:18941:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787784754.232804:0:18941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20bc160 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc167 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784754.232815:0:18941:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20bc160 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc167 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787784754.232870:0:18941:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787784754.232873:0:18941:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787784754.232874:0:18941:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784754.232876:0:18941:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784754.232877:0:18941:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784754.232878:0:18941:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784754.232879:0:18941:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787784754.232881:0:18941:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787784754.232882:0:18941:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784754.232883:0:18941:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787784754.232887:0:18941:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787784754.232890:0:18941:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787784754.232891:0:18941:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787784754.232892:0:18941:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784754.232893:0:18941:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784754.232894:0:18941:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784754.232895:0:18941:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784754.232896:0:18941:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787784754.232897:0:18941:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787784754.232898:0:18941:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784754.232899:0:18941:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787784754.232945:0:18941:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787784754.232962:0:18941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643174272:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787784754.233014:0:18941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784754.233046:0:18941:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b44f63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784754.237304:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643174272 00000100:00100000:0.0:1787784754.237320:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643174272 00000100:00100000:0.0:1787784754.237394:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787784754.237405:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+12:18941:x1874627643174272:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787784754.237436:0:18953:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787784754.237450:0:18953:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787784754.294736:0:18953:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787784754.294758:0:18953:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787784754.294808:0:18975:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787784754.294813:0:18975:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787784754.294835:0:18975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9431bf7f1600/0xffb8d925c20bc17c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784754.294869:0:18975:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431bf7f0200/0xffb8d925c20bc14b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc144 expref: 12 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784754.294878:0:18975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9431bf7f1600/0xffb8d925c20bc17c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784754.294917:0:18975:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431bf7f0200/0xffb8d925c20bc14b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20bc144 expref: 12 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784754.294942:0:18975:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9431bf7f0200/0xffb8d925c20bc14b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20bc144 expref: 12 pid: 18952 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784754.294959:0:18975:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b7c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18975:1874627643174400:0@lo:104: 00000100:00100000:2.0:1787784754.295040:0:18975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784754.295108:0:18975:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318654b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787784754.295249:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643174400 00000100:00100000:0.0:1787784754.295257:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643174400 00000100:00100000:0.0:1787784754.295315:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784754.295325:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17693f43-cfcf-4d1e-8495-73723b171a31+3:18975:x1874627643174400:12345-0@lo:104: 00010000:00010000:0.0:1787784754.295338:0:18942:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20bc144 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bc14b expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784754.295420:0:18942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787784754.295426:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17693f43-cfcf-4d1e-8495-73723b171a31+3:18975:x1874627643174400:12345-0@lo:104: Request processed in 103us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784754.295432:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787784754.295453:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784754.295459:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20bc144 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bc14b expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784754.295478:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943181513c00 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:0.0:1787784754.295481:0:18948:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20bc144 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20bc14b expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784754.295490:0:18948:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20bc144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20bc14b expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784754.295497:0:18948:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20bc144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20bc14b expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784754.295503:0:18948:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787784754.295545:0:18948:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20bc144 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bc14b expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784754.295552:0:18948:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784754.295568:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20bc144 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bc14b expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784754.295574:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20bc144 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bc14b expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784754.295591:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784754.295592:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784754.295594:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784754.295783:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17693f43-cfcf-4d1e-8495-73723b171a31:3296:1874627643174528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784754.295815:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784754.295886:0:18975:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b7c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18975:1874627643174400:0@lo:104: 00010000:00010000:2.0:1787784754.295904:0:18975:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9431bf7f1600/0xffb8d925c20bc17c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784754.296313:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643174528 00000100:00100000:0.0:1787784754.296318:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643174528 00010000:00010000:0.0:1787784754.296336:0:18944:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431bf7f0200/0xffb8d925c20bc14b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bc144 expref: 13 pid: 18952 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784754.296395:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784754.296411:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17693f43-cfcf-4d1e-8495-73723b171a31+13:3296:x1874627643174528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784754.296423:0:18944:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784754.296428:0:18944:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431bf7f0200/0xffb8d925c20bc14b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bc144 expref: 13 pid: 18952 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784754.296438:0:18944:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431bf7f0200/0xffb8d925c20bc14b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20bc144 expref: 13 pid: 18952 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784754.296455:0:18944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf7f0200/0xffb8d925c20bc14b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20bc144 expref: 13 pid: 18952 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784754.296469:0:18944:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9431bf7f1600/0xffb8d925c20bc17c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784754.296478:0:18944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf7f1600/0xffb8d925c20bc17c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787784754.296491:0:18944:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001679199s 00010000:00010000:0.0:1787784754.296496:0:18944:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9431bf7f1600/0xffb8d925c20bc17c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784754.296503:0:18944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9431bf7f1600/0xffb8d925c20bc17c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784754.296510:0:18944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9431bf7f1600/0xffb8d925c20bc17c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784754.296719:0:18944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9431bf7f1600/0xffb8d925c20bc17c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784754.296726:0:18944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784754.296737:0:18944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9431bf7f1600/0xffb8d925c20bc17c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784754.296745:0:18944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9431bf7f1600/0xffb8d925c20bc17c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784754.296765:0:18944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9431bf7f1600/0xffb8d925c20bc17c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784754.296776:0:18944:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784754.296819:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17693f43-cfcf-4d1e-8495-73723b171a31+12:3296:x1874627643174528:12345-0@lo:103:ldlm_bl.0 Request processed in 410us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784754.296827:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787784754.296892:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17693f43-cfcf-4d1e-8495-73723b171a31:3296:1874627643174528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784754.296916:0:18975:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9431bf7f1600/0xffb8d925c20bc17c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784754.296923:0:18975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9431bf7f1600/0xffb8d925c20bc17c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784754.296951:0:18975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf7f1600/0xffb8d925c20bc17c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784754.308395:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+11:18941:x1874627643174272:12345-0@lo:253:mount.lustre.0 Request processed in 70959us (75346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784754.308410:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787784754.308657:0:18941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:18941:1874627643174272:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787784754.308675:0:18941:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787784754.308678:0:18941:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787784754.308680:0:18941:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787784754.308699:0:18941:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787784754.308701:0:18941:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787784754.308702:0:18941:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787784754.308703:0:18941:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787784754.308704:0:18941:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787784754.308706:0:18941:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787784754.308708:0:18941:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787784754.308710:0:18941:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787784754.308727:0:18941:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787784754.317023:0:18941:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787784754.317272:0:18941:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787784754.317727:0:18941:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787784754.318048:0:18941:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787784754.318432:0:18941:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787784754.318666:0:18941:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787784754.319774:0:18941:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787784754.320093:0:18941:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787784754.320619:0:18941:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787784754.320911:0:18941:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787784754.321315:0:18941:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787784754.321704:0:18941:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1787784754.353563:0:18941:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967527 00000040:01000000:2.0:1787784754.356098:0:18941:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787784754.356109:0:18998:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967527 00000020:00080000:0.0:1787784754.356114:0:18998:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000040:01000000:0.0:1787784754.356817:0:18999:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1787784754.356961:0:18999:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787784754.359850:0:18999:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787784754.359944:0:18999:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787784754.359948:0:18999:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1787784754.368649:0:18941:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787784754.368829:0:18941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787784754.370114:0:18941:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787784754.370133:0:18941:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787784754.370799:0:18941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784754.372793:0:18941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787784754.373849:0:18941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787784754.374031:0:18941:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787784754.375908:0:18941:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1787784754.379123:0:18941:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:2.0:1787784754.393629:0:18941:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1787784754.431868:0:18941:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787784754.432096:0:18941:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb46dc1c73988 00100000:10000000:2.0:1787784754.432106:0:18941:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787784754.433159:0:18941:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787784754.433176:0:18941:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.159@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787784754.433192:0:18941:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1787784754.434146:0:18941:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1787784754.686250:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787784754.788853:0:18956:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787784754.788861:0:18956:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9430827c4800 from 9 10000000:01000000:0.0:1787784754.788865:0:18956:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787784754.788917:0:18956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bee88200/0xffb8d925c20bc183 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784754.788930:0:18956:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bee88200/0xffb8d925c20bc183 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784754.788941:0:18956:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bee88200/0xffb8d925c20bc183 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784754.788977:0:18956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45afc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643174656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787784754.789040:0:18956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784754.789123:0:18956:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318916d240 going to sleep for 11 seconds 00000100:00100000:3.0:1787784754.794230:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643174656 00000100:00100000:3.0:1787784754.794248:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643174656 00000100:00100000:3.0:1787784754.794318:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787784754.794331:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+11:18956:x1874627643174656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784754.794349:0:18954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784754.794391:0:18954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf501400/0xffb8d925c20bc18a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bc183 expref: -99 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784754.794449:0:18954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf501400/0xffb8d925c20bc18a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bc183 expref: 12 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784754.794462:0:18954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf501400/0xffb8d925c20bc18a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc183 expref: 12 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784754.794472:0:18954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501400, rc 0) 00000100:00100000:3.0:1787784754.795639:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+12:18956:x1874627643174656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1304us (6591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784754.795649:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787784754.797199:0:18956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45afc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643174656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784754.797230:0:18956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bee88200/0xffb8d925c20bc183 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc18a expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784754.797243:0:18956:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bee88200/0xffb8d925c20bc183 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bc18a expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784754.799889:0:18956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643174784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787784754.799980:0:18956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784754.800118:0:18956:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318654bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787784754.811467:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643174784 00000100:00100000:0.0:1787784754.811491:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643174784 00000100:00100000:0.0:1787784754.811573:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787784754.811584:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+12:18956:x1874627643174784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787784754.811611:0:18953:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787784754.811635:0:18953:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787784754.811638:0:18953:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1787784754.811769:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+12:18956:x1874627643174784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 186us (11788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784754.811777:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787784754.813805:0:18956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643174784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787784754.813882:0:18956:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787784754.813893:0:18956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bee88200/0xffb8d925c20bc183 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc18a expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784754.813904:0:18956:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bee88200/0xffb8d925c20bc183 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc18a expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787784755.258663:0:18992:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787784755.258673:0:18992:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787784755.259112:0:18992:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787784755.259120:0:18992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1787784755.700461:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787784756.276669:0:18992:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787784756.276684:0:18992:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787784756.277203:0:18992:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1787784756.277276:0:18992:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787784756.277312:0:18992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:0.0:1787784756.725723:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784757.750729:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784758.772661:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787784759.606391:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784759.606398:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784759.606400:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784759.606403:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784759.606406:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787784759.606409:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787784759.606412:0:38:0:(import.c:65:import_set_state_nolock()) ffff9431904c0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787784759.606425:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9431904c0000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:2.0:1787784759.606457:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431b45b4b40 x1874627643175040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787784759.606504:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874627643175040:0@lo:38:kworker.0 00000100:00100000:2.0:1787784759.606615:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784759.606717:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17693f43-cfcf-4d1e-8495-73723b171a31:3293:1874627643174912:0@lo:400:kworker.0 00000100:00100000:2.0:1787784759.606760:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784759.607010:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643175040 00000100:00100000:1.0:1787784759.607018:0:18961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643175040 00000100:00100000:1.0:1787784759.607052:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784759.607069:0:18961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3292:x1874627643175040:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787784759.607094:0:18961:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:1.0:1787784759.607130:0:18961:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xffb8d925c20bc191 00000004:00100000:1.0:1787784759.607143:0:18961:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787784759.607282:0:18961:0:(import.c:65:import_set_state_nolock()) ffff9431bf3c5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784759.607337:0:18961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874627643175040:12345-0@lo:38:kworker.0 Request processed in 267us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784759.607344:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784759.607756:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643174912 00000100:00100000:2.0:1787784759.607761:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643174912 00000100:00100000:2.0:1787784759.607810:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787784759.607817:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+12:3293:x1874627643174912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784759.608068:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+12:3293:x1874627643174912:12345-0@lo:400:kworker.0 Request processed in 251us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784759.608074:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787784759.613287:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17693f43-cfcf-4d1e-8495-73723b171a31:3293:1874627643174912:0@lo:400:kworker.0 00010000:00080000:2.0:1787784759.613336:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9431b45b4b40 x1874627643175040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787784759.613353:0:3292:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787784759.613362:0:3292:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787784759.613389:0:3292:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787784759.613392:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431904c0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787784759.613400:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874627643175040:0@lo:38:kworker.0 00000001:02000400:0.0:1787784759.670941:0:19243:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787784759.799939:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784760.822648:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784761.850147:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784762.868837:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787784763.407575:0:19393:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff5d270710 20000000:00000080:2.0:1787784763.407600:0:19393:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff943184b45000 uarg=0000000000000000 20000000:01000000:2.0:1787784763.408294:0:19393:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787784763.408306:0:19393:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787784763.408312:0:19393:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787784763.412088:0:19394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1787784763.412319:0:19393:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787784763.428930:0:19393:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787784763.429111:0:19393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9431bf7f1c00/0xffb8d925c20bc198 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784763.429141:0:19393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431bf500a00/0xffb8d925c20bc159 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc152 expref: 11 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784763.429152:0:19393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9431bf7f1c00/0xffb8d925c20bc198 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784763.429250:0:19393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431bf500a00/0xffb8d925c20bc159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20bc152 expref: 11 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784763.429272:0:19393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9431bf500a00/0xffb8d925c20bc159 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20bc152 expref: 11 pid: 18954 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784763.429291:0:19393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b6940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19393:1874627643175168:0@lo:104: 00000100:00100000:2.0:1787784763.429407:0:19393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784763.429501:0:19393:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318916d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784763.432131:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643175168 00000100:00100000:3.0:1787784763.432147:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643175168 00000100:00100000:3.0:1787784763.432214:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787784763.432224:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17693f43-cfcf-4d1e-8495-73723b171a31+3:19393:x1874627643175168:12345-0@lo:104: 00010000:00010000:3.0:1787784763.432242:0:18943:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20bc152 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bc159 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784763.432568:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787784763.432575:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17693f43-cfcf-4d1e-8495-73723b171a31+3:19393:x1874627643175168:12345-0@lo:104: Request processed in 353us (3169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784763.432584:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787784763.432608:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784763.432615:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20bc152 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bc159 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784763.432622:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943181513400 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:3.0:1787784763.432626:0:18948:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20bc152 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20bc159 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784763.432634:0:18948:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20bc152 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20bc159 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784763.432641:0:18948:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20bc152 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20bc159 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784763.432662:0:18948:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787784763.432697:0:18948:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20bc152 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bc159 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784763.432703:0:18948:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784763.432724:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20bc152 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bc159 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784763.432731:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20bc152 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bc159 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784763.432752:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784763.432754:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784763.432755:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784763.432777:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17693f43-cfcf-4d1e-8495-73723b171a31:3294:1874627643175296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784763.432817:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784763.432906:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643175296 00000100:00100000:3.0:1787784763.432912:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643175296 00010000:00010000:3.0:1787784763.432934:0:18945:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431bf500a00/0xffb8d925c20bc159 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bc152 expref: 12 pid: 18954 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784763.432943:0:19393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b6940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19393:1874627643175168:0@lo:104: 00000100:00100000:3.0:1787784763.432969:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787784763.432982:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17693f43-cfcf-4d1e-8495-73723b171a31+12:3294:x1874627643175296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787784763.432985:0:19393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9431bf7f1c00/0xffb8d925c20bc198 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784763.432994:0:18945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784763.433004:0:18945:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431bf500a00/0xffb8d925c20bc159 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bc152 expref: 12 pid: 18954 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784763.433018:0:18945:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431bf500a00/0xffb8d925c20bc159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20bc152 expref: 12 pid: 18954 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784763.433040:0:18945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf500a00/0xffb8d925c20bc159 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20bc152 expref: 12 pid: 18954 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784763.433054:0:18945:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9431bf7f1c00/0xffb8d925c20bc198 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784763.433061:0:18945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf7f1c00/0xffb8d925c20bc198 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784763.433077:0:18945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9431bf7f1c00/0xffb8d925c20bc198 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784763.433086:0:18945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9431bf7f1c00/0xffb8d925c20bc198 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784763.437396:0:18945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9431bf7f1c00/0xffb8d925c20bc198 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784763.437408:0:18945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9431bf7f1c00/0xffb8d925c20bc198 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784763.437416:0:18945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1c00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784763.437421:0:18945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9431bf7f1c00/0xffb8d925c20bc198 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784763.437442:0:18945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9431bf7f1c00/0xffb8d925c20bc198 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784763.437470:0:18945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9431bf7f1c00/0xffb8d925c20bc198 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784763.437517:0:18945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784763.437583:0:19393:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9431bf7f1c00/0xffb8d925c20bc198 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784763.437602:0:19393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9431bf7f1c00/0xffb8d925c20bc198 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784763.437617:0:19393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf7f1c00/0xffb8d925c20bc198 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784763.439390:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17693f43-cfcf-4d1e-8495-73723b171a31+11:3294:x1874627643175296:12345-0@lo:103:ldlm_bl.0 Request processed in 6374us (6534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784763.439418:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784763.440280:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17693f43-cfcf-4d1e-8495-73723b171a31:3294:1874627643175296:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784763.895493:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784764.724985:0:3292:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784754/real 1787784754] req@ffff9431b45b5a40 x1874627643172224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784764 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784764.725016:0:3292:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9431b45b5a40 x1874627643172224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784764 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784764.725027:0:3292:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784754/real 1787784754] req@ffff9431b45af0c0 x1874627643172096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784764 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784764.725042:0:3292:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9431b45af0c0 x1874627643172096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784764 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787784764.725060:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431b5c4d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787784764.725082:0:3292:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787784764.725086:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643172224:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787784764.725091:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431bed64000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787784764.725096:0:3292:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787784764.725099:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643172096:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787784764.725338:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784764.725343:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787784764.725347:0:38:0:(import.c:65:import_set_state_nolock()) ffff9431bed64000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787784764.725353:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 568 00000100:00080000:1.0:1787784764.725358:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787784764.725384:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9431bed64000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:1.0:1787784764.725405:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff943189161680 x1874627643175552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787784764.725439:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784764.725443:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787784764.725445:0:38:0:(import.c:65:import_set_state_nolock()) ffff9431b5c4d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787784764.725449:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 568 00000100:00080000:1.0:1787784764.725451:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787784764.725455:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9431b5c4d800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:1.0:1787784764.725469:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431891621c0 x1874627643175680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787784764.725503:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431891630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643175808:0@lo:400:kworker.0 00000100:00100000:1.0:1787784764.725572:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784764.725628:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787784764.725634:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431891612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17693f43-cfcf-4d1e-8495-73723b171a31:3296:1874627643175424:0@lo:400:kworker.0 00000100:00100000:1.0:1787784764.725662:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784764.725691:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643175808 00000100:00100000:1.0:1787784764.725697:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643175808 00000100:00100000:1.0:1787784764.725740:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784764.725932:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189160f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643175808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784764.725988:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189160f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643175808:12345-0@lo:400:kworker.0 Request processed in 240us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784764.725995:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787784764.726035:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9431891630c0 x1874627643175808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784764.726047:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431891630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643175808:0@lo:400:kworker.0 00000100:00100000:3.0:1787784764.728291:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643175424 00000100:00100000:3.0:1787784764.728303:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643175424 00000100:00100000:3.0:1787784764.728357:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787784764.728397:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+11:3296:x1874627643175424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784764.728491:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+11:3296:x1874627643175424:12345-0@lo:400:kworker.0 Request processed in 126us (2827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784764.728499:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787784764.728561:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189161680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643175552:0@lo:8:kworker.0 00000400:00000100:3.0:1787784764.728594:0:3292:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627643175552 offset 0 length 520: 4 00000100:00100000:3.0:1787784764.728622:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431891621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643175680:0@lo:8:kworker.0 00000400:00000100:3.0:1787784764.728644:0:3292:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627643175680 offset 0 length 520: 4 00000100:00100000:3.0:1787784764.728682:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431891612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17693f43-cfcf-4d1e-8495-73723b171a31:3296:1874627643175424:0@lo:400:kworker.0 00010000:00010000:3.0:1787784764.917532:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787784765.431394:0:18956:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787784765.431403:0:18956:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9430827c4800 from 10 10000000:01000000:0.0:1787784765.431419:0:18956:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787784765.431472:0:18956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bc19f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784765.431486:0:18956:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bc19f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784765.431499:0:18956:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bc19f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784765.431526:0:18956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45afc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643175936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787784765.431614:0:18956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784765.431675:0:18956:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185755780 going to sleep for 11 seconds 00000100:00100000:2.0:1787784765.432151:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643175936 00000100:00100000:2.0:1787784765.432160:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643175936 00000100:00100000:2.0:1787784765.432223:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787784765.432234:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+11:18956:x1874627643175936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784765.432250:0:18953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784765.432266:0:18953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf7f0800/0xffb8d925c20bc1a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bc19f expref: -99 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784765.432293:0:18953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf7f0800/0xffb8d925c20bc1a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bc19f expref: 12 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784765.432304:0:18953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf7f0800/0xffb8d925c20bc1a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc19f expref: 12 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784765.432313:0:18953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf7f0800, rc 0) 00000100:00100000:2.0:1787784765.432396:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+12:18956:x1874627643175936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784765.432423:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787784765.432577:0:18956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45afc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643175936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784765.432602:0:18956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bc19f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc1a6 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784765.432614:0:18956:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bc19f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bc1a6 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784765.432694:0:18956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643176064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784765.432752:0:18956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784765.432779:0:18956:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ddd000 going to sleep for 11 seconds 00000100:00100000:1.0:1787784765.432794:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643176064 00000100:00100000:1.0:1787784765.432797:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643176064 00000100:00100000:1.0:1787784765.432824:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787784765.432831:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+12:18956:x1874627643176064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784765.433146:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+12:18956:x1874627643176064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 315us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784765.433154:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787784765.433189:0:18956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643176064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784765.433222:0:18956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643176192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784765.433261:0:18956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784765.433275:0:18956:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ddd000 going to sleep for 11 seconds 00000100:00100000:1.0:1787784765.433287:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643176192 00000100:00100000:1.0:1787784765.433290:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643176192 00000100:00100000:1.0:1787784765.433313:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787784765.433318:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+12:18956:x1874627643176192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784765.433497:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+12:18956:x1874627643176192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784765.433512:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787784765.433552:0:18956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643176192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787784765.434189:0:19458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787784765.434252:0:18956:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787784765.434266:0:18956:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787784765.434276:0:18956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bc19f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc1a6 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784765.434286:0:18956:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bc19f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc1a6 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784765.942167:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787784766.526007:0:18992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787784766.966877:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784767.989422:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784769.016449:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787784769.399522:0:19642:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787784769.399527:0:19642:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787784769.399642:0:19642:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9431900a1800 00000020:01000004:3.0:1787784769.399659:0:19642:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787784769.399672:0:19642:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787784769.399685:0:19642:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9431908fb370) 00000020:00000080:3.0:1787784769.399701:0:19642:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787784769.427011:0:19642:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787784769.427472:0:19642:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787784769.428159:0:19642:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787784769.428559:0:19642:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1787784769.428782:0:19642:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:1.0:1787784769.439781:0:19642:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:1.0:1787784769.439923:0:19642:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:1.0:1787784769.440071:0:19642:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:1.0:1787784769.441811:0:19642:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 694: rc = 0 00100000:10000000:1.0:1787784769.442711:0:19642:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 694: rc = 0 00100000:10000000:1.0:1787784769.443065:0:19642:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 694: rc = 0 00100000:10000000:1.0:1787784769.444560:0:19642:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 694: rc = 0 00100000:10000000:1.0:1787784769.444867:0:19642:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 694: rc = 0 00100000:10000000:1.0:1787784769.445148:0:19642:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 694: rc = 0 00000020:00000080:1.0:1787784769.447190:0:19642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787784769.447202:0:19642:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787784769.447214:0:19642:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xffb8d925c20bc1b4 00000020:01000004:1.0:1787784769.447222:0:19642:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1787784769.449525:0:19642:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.159@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787784769.449532:0:19642:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787784769.449544:0:19642:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787784769.449551:0:19642:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787784769.449573:0:19642:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9431b62619b8) 00000020:00000080:1.0:1787784769.449590:0:19642:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1787784769.450839:0:19642:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787784769.451026:0:19642:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787784769.451033:0:19642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787784769.470619:0:19642:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787784769.470638:0:19642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787784769.472144:0:19642:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787784769.472156:0:19642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787784769.475014:0:19642:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784769.478100:0:19642:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787784769.478121:0:19642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787784769.479039:0:19642:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787784769.479047:0:19642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787784769.502358:0:19642:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784769.502644:0:19642:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787784769.502651:0:19642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787784769.514221:0:19642:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787784769.514247:0:19642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787784769.530277:0:19642:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787784769.530293:0:19642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787784769.532749:0:19642:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787784769.532978:0:19642:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787784769.532985:0:19642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787784769.541570:0:19642:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787784769.541597:0:19642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787784769.613623:0:19642:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787784769.614610:0:19642:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787784769.614624:0:19642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787784769.616184:0:19642:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787784769.616197:0:19642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787784769.616692:0:19642:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787784769.616716:0:19642:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787784769.616722:0:19642:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.159@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787784769.642485:0:19642:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.159@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787784769.642530:0:19642:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.159@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1787784769.642535:0:19642:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787784769.642537:0:19642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787784769.642538:0:19642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784769.642540:0:19642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784769.642541:0:19642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784769.642542:0:19642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784769.642544:0:19642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787784769.642546:0:19642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784769.642547:0:19642:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787784769.642551:0:19642:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1787784769.642554:0:19642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787784769.642555:0:19642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787784769.642556:0:19642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784769.642557:0:19642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784769.642558:0:19642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784769.642559:0:19642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784769.642561:0:19642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787784769.642562:0:19642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784769.642563:0:19642:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787784769.642590:0:19642:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787784769.642622:0:19642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643176320:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787784769.642711:0:19642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784769.642765:0:19642:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431907ccd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784769.642882:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643176320 00000100:00100000:1.0:1787784769.642890:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643176320 00000100:00100000:1.0:1787784769.642950:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787784769.642960:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+12:19642:x1874627643176320:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787784769.642992:0:18954:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787784769.642996:0:18954:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787784769.643000:0:18954:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787784769.668967:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+12:19642:x1874627643176320:12345-0@lo:253:mount.lustre.0 Request processed in 25994us (26242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784769.668990:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787784769.671281:0:19642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643176320:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787784769.671302:0:19642:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787784769.671305:0:19642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787784769.671307:0:19642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787784769.671308:0:19642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784769.671310:0:19642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784769.671311:0:19642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784769.671312:0:19642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784769.671314:0:19642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787784769.671316:0:19642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784769.671317:0:19642:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787784769.671345:0:19642:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9431900a1800 from lustre-OST0000 10000000:01000000:0.0:1787784769.671412:0:19642:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787784769.671414:0:19642:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787784769.671421:0:19642:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9431885e3370 local copy 00010000:00010000:0.0:1787784769.671433:0:19642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bee89c00/0xffb8d925c20bc0aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc0b1 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784769.671877:0:19642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189160000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643176448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784769.671961:0:19642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784769.672014:0:19642:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318654b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787784769.672159:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643176448 00000100:00100000:0.0:1787784769.672168:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643176448 00000100:00100000:0.0:1787784769.672232:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787784769.672241:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+12:19642:x1874627643176448:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784769.672452:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+12:19642:x1874627643176448:12345-0@lo:501:mount.lustre.0 Request processed in 212us (490us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787784769.672459:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787784769.673962:0:19642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189160000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643176448:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787784769.673998:0:19642:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787784769.674267:0:19642:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787784769.674279:0:19642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bee89c00/0xffb8d925c20bc0aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc0b1 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784769.674291:0:19642:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bee89c00/0xffb8d925c20bc0aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc0b1 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784769.674331:0:19642:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9431900a1800 10000000:01000000:1.0:1787784769.674338:0:19642:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787784769.674344:0:19642:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9431885e3370 10000000:01000000:1.0:1787784769.674346:0:19642:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787784769.674350:0:19642:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9431885e3370 from 1 10000000:01000000:1.0:1787784769.674353:0:19642:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787784769.674448:0:19642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181513000/0xffb8d925c20bc1c2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784769.674457:0:19642:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943181513000/0xffb8d925c20bc1c2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784769.674468:0:19642:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943181513000/0xffb8d925c20bc1c2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784769.674494:0:19642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189160000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643176576:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787784769.674571:0:19642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784769.675598:0:19642:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318654b000 going to sleep for 11 seconds 00000100:00100000:2.0:1787784769.675758:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643176576 00000100:00100000:2.0:1787784769.675769:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643176576 00000100:00100000:2.0:1787784769.675894:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787784769.675907:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+12:19642:x1874627643176576:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784769.675928:0:18954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784769.675955:0:18954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf7f1600/0xffb8d925c20bc1c9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bc1c2 expref: -99 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784769.675987:0:18954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf7f1600/0xffb8d925c20bc1c9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bc1c2 expref: 13 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784769.676000:0:18954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf7f1600/0xffb8d925c20bc1c9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc1c2 expref: 13 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784769.676011:0:18954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf7f1600, rc 0) 00000100:00100000:2.0:1787784769.676091:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+13:19642:x1874627643176576:12345-0@lo:101:mount.lustre.0 Request processed in 187us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784769.676099:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787784769.676199:0:19642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189160000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643176576:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784769.676217:0:19642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943181513000/0xffb8d925c20bc1c2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc1c9 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784769.676227:0:19642:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943181513000/0xffb8d925c20bc1c2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bc1c9 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784769.676251:0:19642:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787784769.676276:0:19642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181513000/0xffb8d925c20bc1c2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc1c9 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784769.676286:0:19642:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943181513000/0xffb8d925c20bc1c2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc1c9 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784769.676294:0:19642:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787784769.676300:0:19642:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787784769.676307:0:19642:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787784769.676310:0:19642:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787784769.676337:0:19642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20bc1d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784769.676345:0:19642:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20bc1d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784769.676354:0:19642:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20bc1d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784769.676410:0:19642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189160000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643176704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787784769.676458:0:19642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784769.676807:0:19642:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318654b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787784769.676953:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643176704 00000100:00100000:0.0:1787784769.676960:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643176704 00000100:00100000:0.0:1787784769.676995:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787784769.677013:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+13:19642:x1874627643176704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784769.677025:0:18952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784769.677037:0:18952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bee88e00/0xffb8d925c20bc1d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bc1d0 expref: -99 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784769.677056:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bee88e00/0xffb8d925c20bc1d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bc1d0 expref: 14 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784769.677066:0:18952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bee88e00/0xffb8d925c20bc1d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc1d0 expref: 14 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784769.677073:0:18952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88e00, rc 0) 00000100:00100000:0.0:1787784769.677119:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+14:19642:x1874627643176704:12345-0@lo:101:mount.lustre.0 Request processed in 109us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784769.677125:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787784769.677214:0:19642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189160000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643176704:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784769.677228:0:19642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20bc1d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc1d7 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784769.677236:0:19642:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20bc1d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bc1d7 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787784769.680996:0:19642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1787784769.681998:0:19642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784769.682303:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1787784769.682347:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1787784769.682425:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1787784769.682491:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1787784769.682546:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1787784769.682575:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1787784769.682620:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1787784769.682650:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1787784769.682675:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1787784769.682714:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1787784769.682749:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1787784769.682791:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1787784769.682867:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1787784769.682876:0:19642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1787784769.683001:0:19642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643176832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784769.683096:0:19642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784769.683169:0:19642:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185755540 going to sleep for 11 seconds 00000100:00100000:3.0:1787784769.683403:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643176832 00000100:00100000:3.0:1787784769.683413:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643176832 00000100:00100000:3.0:1787784769.683479:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787784769.683492:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+14:19642:x1874627643176832:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784769.683990:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+14:19642:x1874627643176832:12345-0@lo:501:mount.lustre.0 Request processed in 499us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784769.684006:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787784769.684171:0:19642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643176832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784769.684232:0:19642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189160000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643176960:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784769.684286:0:19642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784769.684323:0:19642:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318654b000 going to sleep for 11 seconds 00000100:00100000:3.0:1787784769.684454:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643176960 00000100:00100000:3.0:1787784769.684460:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643176960 00000100:00100000:3.0:1787784769.684497:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787784769.684505:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+14:19642:x1874627643176960:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787784769.684877:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+14:19642:x1874627643176960:12345-0@lo:503:mount.lustre.0 Request processed in 371us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784769.684886:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787784769.685049:0:19642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189160000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643176960:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787784769.685837:0:19642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787784769.685947:0:19642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189160000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643177088:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784769.686024:0:19642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784769.686059:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643177088 00000100:00100000:1.0:1787784769.686063:0:19642:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431887ef600 going to sleep for 11 seconds 00000100:00100000:2.0:1787784769.686068:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643177088 00000100:00100000:2.0:1787784769.686132:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787784769.686143:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+14:19642:x1874627643177088:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784769.686958:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+14:19642:x1874627643177088:12345-0@lo:502:mount.lustre.0 Request processed in 810us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784769.686969:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787784769.687195:0:19642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189160000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643177088:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787784769.688114:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1787784769.689162:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1787784769.689676:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1787784769.689932:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1787784769.689975:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1787784769.690010:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1787784769.690060:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1787784769.690098:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1787784769.690135:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1787784769.690187:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1787784769.690243:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1787784769.690455:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1787784769.690538:0:19642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643177216:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784769.690674:0:19642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784769.690990:0:19642:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318636bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784769.691071:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643177216 00000100:00100000:1.0:1787784769.691084:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643177216 00000100:00100000:1.0:1787784769.691199:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787784769.691210:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+14:19642:x1874627643177216:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784769.691972:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+14:19642:x1874627643177216:12345-0@lo:502:mount.lustre.0 Request processed in 758us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784769.691985:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787784769.692081:0:19642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643177216:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787784769.692334:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1787784769.692356:0:19642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1787784769.693934:0:19656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787784769.693949:0:19656:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787784769.693957:0:19656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784769.693960:0:19656:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787784769.693968:0:19656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787784769.693991:0:19656:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9431885e0000) 00000020:00000080:0.0:1787784769.694022:0:19656:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787784769.694031:0:19656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787784769.694136:0:19656:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9431900a1800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787784769.694146:0:19656:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787784769.694154:0:19656:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xffb8d925c20bc1e5 00010000:00010000:2.0:1787784769.706771:0:19656:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1787784769.707573:0:19656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934605 00080000:10000000:3.0:1787784769.714303:0:19656:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:3.0:1787784769.728660:0:19656:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787784769.728682:0:19656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784769.728691:0:19656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784769.728693:0:19656:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787784769.728697:0:19656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787784769.728713:0:19656:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1787784769.728716:0:19656:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787784769.728717:0:19656:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787784769.728719:0:19656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787784769.728723:0:19656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784769.728724:0:19656:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787784769.728726:0:19656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784769.728729:0:19656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784769.728731:0:19656:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787784769.728734:0:19656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787784769.728736:0:19656:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787784769.728739:0:19656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784769.728741:0:19656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784769.728743:0:19656:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787784769.728745:0:19656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784769.728747:0:19656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784769.728748:0:19656:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787784769.728751:0:19656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787784769.728853:0:19656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784769.728857:0:19656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784769.728859:0:19656:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787784769.728863:0:19656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1787784769.729519:0:19642:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787784769.729565:0:19642:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787784769.729590:0:19642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20bc1d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc1d7 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784769.729618:0:19642:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20bc1d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc1d7 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784769.729627:0:19642:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9431900a1800 from 1 10000000:01000000:0.0:1787784769.729630:0:19642:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787784769.729684:0:19642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bee88000/0xffb8d925c20bc1ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784769.729693:0:19642:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bee88000/0xffb8d925c20bc1ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784769.729705:0:19642:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bee88000/0xffb8d925c20bc1ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784769.729737:0:19642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643177344:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787784769.729855:0:19642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784769.729930:0:19642:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431907cc600 going to sleep for 11 seconds 00000100:00100000:1.0:1787784769.729955:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643177344 00000100:00100000:1.0:1787784769.729970:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643177344 00000100:00100000:1.0:1787784769.730047:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787784769.730062:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+14:19642:x1874627643177344:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784769.730082:0:18954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784769.730102:0:18954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943181512800/0xffb8d925c20bc1f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bc1ec expref: -99 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784769.730132:0:18954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943181512800/0xffb8d925c20bc1f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bc1ec expref: 15 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784769.730159:0:18954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943181512800/0xffb8d925c20bc1f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc1ec expref: 15 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784769.730170:0:18954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943181512800, rc 0) 00000100:00100000:1.0:1787784769.730257:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+15:19642:x1874627643177344:12345-0@lo:101:mount.lustre.0 Request processed in 199us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784769.730265:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787784769.734131:0:19642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643177344:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784769.734191:0:19642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bee88000/0xffb8d925c20bc1ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc1f3 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784769.734208:0:19642:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bee88000/0xffb8d925c20bc1ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bc1f3 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787784769.735063:0:19642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:0.0:1787784769.735698:0:19642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787784769.736073:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1787784769.736149:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1787784769.736221:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1787784769.736269:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1787784769.736337:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1787784769.736450:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1787784769.736514:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1787784769.736590:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1787784769.736737:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1787784769.736757:0:19642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:3.0:1787784769.743706:0:19642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643177472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784769.743815:0:19642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784769.743911:0:19642:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318636b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787784769.744287:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643177472 00000100:00100000:0.0:1787784769.744297:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643177472 00000100:00100000:0.0:1787784769.744411:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787784769.744424:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+15:19642:x1874627643177472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784769.744817:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+15:19642:x1874627643177472:12345-0@lo:501:mount.lustre.0 Request processed in 396us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784769.744838:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787784769.745085:0:19642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643177472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784769.745148:0:19642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643177600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787784769.745195:0:19642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784769.745221:0:19642:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318636b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787784769.745463:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643177600 00000100:00100000:0.0:1787784769.745470:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643177600 00000100:00100000:0.0:1787784769.745515:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787784769.745524:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+15:19642:x1874627643177600:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784769.745733:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+15:19642:x1874627643177600:12345-0@lo:503:mount.lustre.0 Request processed in 210us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784769.745739:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787784769.745902:0:19642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643177600:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787784769.746643:0:19642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787784769.746785:0:19642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643177728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784769.746865:0:19642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784769.746902:0:19642:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318636b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787784769.747205:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643177728 00000100:00100000:0.0:1787784769.747214:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643177728 00000100:00100000:0.0:1787784769.747355:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787784769.747399:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+15:19642:x1874627643177728:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784769.747761:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+15:19642:x1874627643177728:12345-0@lo:502:mount.lustre.0 Request processed in 396us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784769.747777:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787784769.747925:0:19642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643177728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787784769.748199:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1787784769.749007:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1787784769.749091:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1787784769.749132:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1787784769.749194:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1787784769.749315:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1787784769.749356:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1787784769.749701:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:3.0:1787784769.749766:0:19642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643177856:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784769.749885:0:19642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784769.749999:0:19642:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318636b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787784769.755049:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643177856 00000100:00100000:0.0:1787784769.755073:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643177856 00000100:00100000:0.0:1787784769.755171:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787784769.755187:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+15:19642:x1874627643177856:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784769.755861:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+15:19642:x1874627643177856:12345-0@lo:502:mount.lustre.0 Request processed in 676us (5974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784769.755871:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787784769.758566:0:19642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643177856:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787784769.758851:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1787784769.758872:0:19642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787784769.761205:0:19660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784769.761226:0:19660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784769.761229:0:19660:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787784769.761247:0:19660:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9431900a1800 00000020:00000080:1.0:1787784769.761252:0:19660:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787784769.761264:0:19660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784769.761267:0:19660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784769.761269:0:19660:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787784769.761271:0:19660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784769.761274:0:19660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784769.761276:0:19660:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787784769.761279:0:19660:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9431900a1800 00000020:00000080:1.0:1787784769.761281:0:19660:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787784769.761410:0:19660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784769.761414:0:19660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784769.761416:0:19660:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787784769.761419:0:19660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784769.761422:0:19660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784769.761424:0:19660:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787784769.761427:0:19660:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9431900a1800 00000020:00000080:1.0:1787784769.761429:0:19660:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787784769.761472:0:19660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784769.761476:0:19660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784769.761596:0:19660:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787784769.761603:0:19660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:0.0:1787784769.761798:0:19642:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787784769.761847:0:19642:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787784769.761880:0:19642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bee88000/0xffb8d925c20bc1ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc1f3 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784769.761897:0:19642:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bee88000/0xffb8d925c20bc1ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc1f3 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784769.761966:0:19642:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787784769.761971:0:19642:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9431900a1800 10000000:01000000:0.0:1787784769.761975:0:19642:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9431900a1800 10000000:01000000:0.0:1787784769.761982:0:19642:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787784769.761990:0:19642:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9431900a1800 from 1 10000000:01000000:0.0:1787784769.761994:0:19642:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787784769.762050:0:19642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bee89800/0xffb8d925c20bc1fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784769.762060:0:19642:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bee89800/0xffb8d925c20bc1fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784769.762076:0:19642:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bee89800/0xffb8d925c20bc1fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784769.762125:0:19642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643177984:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787784769.762237:0:19642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784769.762303:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643177984 00000100:00100000:0.0:1787784769.762313:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643177984 00000100:00100000:0.0:1787784769.762416:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787784769.762430:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+15:19642:x1874627643177984:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784769.762450:0:18953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784769.762470:0:18953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bee89000/0xffb8d925c20bc201 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bc1fa expref: -99 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784769.762512:0:18953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bee89000/0xffb8d925c20bc201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bc1fa expref: 16 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784769.762525:0:18953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bee89000/0xffb8d925c20bc201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc1fa expref: 16 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784769.762535:0:18953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89000, rc 0) 00000100:00100000:0.0:1787784769.762581:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+16:19642:x1874627643177984:12345-0@lo:101:mount.lustre.0 Request processed in 153us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784769.762588:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787784769.762652:0:19642:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431961aa780 going to sleep for 11 seconds 00000100:00100000:0.0:1787784769.762681:0:19642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643177984:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784769.762703:0:19642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bee89800/0xffb8d925c20bc1fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc201 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784769.762713:0:19642:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bee89800/0xffb8d925c20bc1fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bc201 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787784769.763712:0:19642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:0.0:1787784769.764473:0:19642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787784769.776959:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787784769.777096:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1787784769.777148:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1787784769.777201:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1787784769.777273:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1787784769.777417:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1787784769.777502:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1787784769.777567:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1787784769.777669:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787784769.777701:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1787784769.777719:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1787784769.777753:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1787784769.777784:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1787784769.777800:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1787784769.777861:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1787784769.777886:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1787784769.777902:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1787784769.777929:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1787784769.777962:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1787784769.777980:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1787784769.778006:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1787784769.778034:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1787784769.778051:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1787784769.778079:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1787784769.778108:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:1.0:1787784769.778144:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:1.0:1787784769.778194:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:1.0:1787784769.778233:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:1.0:1787784769.778255:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:1.0:1787784769.778282:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:1.0:1787784769.778300:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:1.0:1787784769.778316:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:1.0:1787784769.778332:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:1.0:1787784769.778356:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:1.0:1787784769.778414:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:1.0:1787784769.778444:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:1.0:1787784769.778475:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:1.0:1787784769.778511:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:1.0:1787784769.778560:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:1.0:1787784769.778595:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:1.0:1787784769.778703:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:1.0:1787784769.778711:0:19642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:1.0:1787784769.778873:0:19642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189160000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643178112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784769.778959:0:19642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784769.779004:0:19642:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318654b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787784769.781504:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643178112 00000100:00100000:0.0:1787784769.781525:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643178112 00000100:00100000:0.0:1787784769.781619:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787784769.781631:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+16:19642:x1874627643178112:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784769.782076:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+16:19642:x1874627643178112:12345-0@lo:501:mount.lustre.0 Request processed in 446us (3114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784769.782086:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787784769.784133:0:19642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189160000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643178112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784769.784229:0:19642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189160000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643178240:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784769.785667:0:19642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784769.785748:0:19642:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318654b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787784769.789801:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643178240 00000100:00100000:0.0:1787784769.789821:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643178240 00000100:00100000:0.0:1787784769.792403:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787784769.792426:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+16:19642:x1874627643178240:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784769.793084:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+16:19642:x1874627643178240:12345-0@lo:503:mount.lustre.0 Request processed in 665us (7426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784769.793095:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787784769.793795:0:19642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189160000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643178240:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787784769.799323:0:19642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787784769.799498:0:19642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189160000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643178368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784769.799631:0:19642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784769.799711:0:19642:0:(client.c:2715:ptlrpc_set_wait()) set ffff943192a44d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784769.800762:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643178368 00000100:00100000:1.0:1787784769.800779:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643178368 00000100:00100000:1.0:1787784769.800866:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787784769.800879:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+16:19642:x1874627643178368:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784769.801339:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+16:19642:x1874627643178368:12345-0@lo:502:mount.lustre.0 Request processed in 460us (1707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784769.801350:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787784769.801473:0:19642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189160000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643178368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787784769.801859:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1787784769.801960:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1787784769.802004:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1787784769.802064:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1787784769.802136:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1787784769.802203:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1787784769.803147:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1787784769.803224:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1787784769.803320:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1787784769.803357:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1787784769.803425:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1787784769.803478:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1787784769.803528:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1787784769.803558:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1787784769.803626:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1787784769.803669:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1787784769.803721:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1787784769.803776:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1787784769.803817:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1787784769.803881:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1787784769.803968:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1787784769.804009:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1787784769.804046:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1787784769.804098:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1787784769.804137:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:1.0:1787784769.804180:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:1.0:1787784769.804250:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:1.0:1787784769.804298:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:1.0:1787784769.804357:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:1.0:1787784769.804501:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:1.0:1787784769.804557:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:1.0:1787784769.804599:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:1.0:1787784769.804652:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:1.0:1787784769.804727:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:1.0:1787784769.804774:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:1.0:1787784769.804824:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:1.0:1787784769.806399:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:1.0:1787784769.806449:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:1.0:1787784769.806607:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:1.0:1787784769.806649:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:1.0:1787784769.806723:0:19642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189160000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643178496:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784769.806846:0:19642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784769.806923:0:19642:0:(client.c:2715:ptlrpc_set_wait()) set ffff943192a44d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787784769.807124:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643178496 00000100:00100000:0.0:1787784769.807143:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643178496 00000100:00100000:0.0:1787784769.807204:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787784769.807225:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+16:19642:x1874627643178496:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784769.808194:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+16:19642:x1874627643178496:12345-0@lo:502:mount.lustre.0 Request processed in 975us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784769.808207:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787784769.808465:0:19642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189160000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643178496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787784769.808726:0:19642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:1.0:1787784769.808747:0:19642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787784769.817743:0:19665:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787784769.817767:0:19665:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9431857e19b8) 00000020:00000080:2.0:1787784769.817804:0:19665:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1787784769.817922:0:19665:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9431900a1800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787784769.817926:0:19665:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9431900a1800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787784769.817929:0:19665:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9431900a1800 3 00010000:00080000:2.0:1787784769.823965:0:19665:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9431be3c3800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.159@tcp at head 00010000:00010000:2.0:1787784769.826822:0:19665:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1787784769.839183:0:19665:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787784769.839227:0:19665:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787784769.839243:0:19665:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xffb8d925c20bc20f 00000100:00080000:2.0:1787784769.839254:0:19665:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787784769.839260:0:19665:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9431be3c3800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:2.0:1787784769.839301:0:19665:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431b45b5e00 x1874627643178624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787784769.839338:0:19665:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787784769.839406:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784769.839411:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784769.839413:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784769.839416:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787784769.839461:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787784769.839475:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874627643178752:0@lo:400:kworker.0 00000100:00100000:2.0:1787784769.839548:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784769.839734:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1874627643178624:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787784769.839821:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784769.839906:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643178752 00000100:00100000:2.0:1787784769.839915:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643178752 00000100:00100000:1.0:1787784769.839945:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643178624 00000100:00100000:1.0:1787784769.839954:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643178624 00000100:00100000:1.0:1787784769.839993:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784769.840007:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874627643178752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784769.840033:0:18959:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787784769.840044:0:18959:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787784769.840107:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874627643178752:12345-0@lo:400:kworker.0 Request processed in 90us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784769.840117:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784769.840137:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787784769.840149:0:18961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3292:x1874627643178624:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787784769.840194:0:18961:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 584 last 0 00000020:00000080:0.0:1787784769.840233:0:18961:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xffb8d925c20bc216 00000004:00100000:0.0:1787784769.840250:0:18961:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787784769.840288:0:18961:0:(import.c:65:import_set_state_nolock()) ffff9431be3f4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784769.840387:0:18961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1874627643178624:12345-0@lo:38:llog_process_th.0 Request processed in 239us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784769.840396:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787784769.840899:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9431b45b43c0 x1874627643178752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784769.840929:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874627643178752:0@lo:400:kworker.0 00010000:00080000:1.0:1787784769.841134:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9431b45b5e00 x1874627643178624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784769.841148:0:3292:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787784769.841160:0:3292:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1787784769.841173:0:3292:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787784769.841181:0:3292:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787784769.841186:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431be3c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787784769.841196:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1874627643178624:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787784769.841309:0:19665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:1.0:1787784769.853468:0:19642:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787784769.853519:0:19642:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787784769.853549:0:19642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bee89800/0xffb8d925c20bc1fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc201 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784769.853562:0:19642:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bee89800/0xffb8d925c20bc1fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc201 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787784769.853650:0:19642:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787784769.853652:0:19642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787784769.853654:0:19642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784769.853661:0:19642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784769.853662:0:19642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784769.853664:0:19642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784769.853665:0:19642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787784769.853666:0:19642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784769.853667:0:19642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787784769.853672:0:19642:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787784769.853674:0:19642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787784769.853676:0:19642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787784769.853677:0:19642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784769.853678:0:19642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784769.853678:0:19642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784769.853679:0:19642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784769.853680:0:19642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787784769.853681:0:19642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784769.853682:0:19642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787784769.853713:0:19642:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787784769.853733:0:19642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643178880:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787784769.853806:0:19642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784769.853876:0:19642:0:(client.c:2715:ptlrpc_set_wait()) set ffff943192a44d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787784769.853880:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643178880 00000100:00100000:0.0:1787784769.853889:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643178880 00000100:00100000:0.0:1787784769.853948:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787784769.853958:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+16:19642:x1874627643178880:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787784769.854000:0:18952:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787784769.854015:0:18952:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787784769.908211:0:18952:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787784769.908240:0:18952:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787784769.908457:0:18975:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787784769.908463:0:18975:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787784769.908494:0:18975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20bc21d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784769.908516:0:18975:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431bf501400/0xffb8d925c20bc18a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc183 expref: 16 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784769.908526:0:18975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20bc21d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784769.908575:0:18975:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431bf501400/0xffb8d925c20bc18a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20bc183 expref: 16 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784769.908604:0:18975:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9431bf501400/0xffb8d925c20bc18a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20bc183 expref: 16 pid: 18954 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784769.908620:0:18975:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b43c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18975:1874627643179008:0@lo:104: 00000100:00100000:2.0:1787784769.908691:0:18975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784769.908742:0:18975:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185613d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787784769.908877:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643179008 00000100:00100000:0.0:1787784769.908886:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643179008 00000100:00100000:0.0:1787784769.908946:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787784769.908963:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17693f43-cfcf-4d1e-8495-73723b171a31+3:18975:x1874627643179008:12345-0@lo:104: 00010000:00010000:0.0:1787784769.908978:0:18942:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff9431bee88200/0xffb8d925c20bc183 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bc18a expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784769.909054:0:18942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787784769.909061:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17693f43-cfcf-4d1e-8495-73723b171a31+3:18975:x1874627643179008:12345-0@lo:104: Request processed in 108us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784769.909069:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787784769.909095:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784769.909102:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431bee88200/0xffb8d925c20bc183 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bc18a expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784769.909126:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88200 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:0.0:1787784769.909130:0:18947:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431bee88200/0xffb8d925c20bc183 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20bc18a expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784769.909140:0:18947:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431bee88200/0xffb8d925c20bc183 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20bc18a expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784769.909147:0:18947:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431bee88200/0xffb8d925c20bc183 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20bc18a expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784769.909153:0:18947:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787784769.909185:0:18947:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431bee88200/0xffb8d925c20bc183 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bc18a expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784769.909193:0:18947:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784769.909213:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431bee88200/0xffb8d925c20bc183 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bc18a expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784769.909221:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431bee88200/0xffb8d925c20bc183 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bc18a expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784769.909240:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784769.909242:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784769.909243:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784769.909264:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17693f43-cfcf-4d1e-8495-73723b171a31:3294:1874627643179136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784769.909293:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784769.909351:0:18975:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b43c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18975:1874627643179008:0@lo:104: 00010000:00010000:0.0:1787784769.909408:0:18975:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20bc21d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784769.909526:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643179136 00000100:00100000:3.0:1787784769.909532:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643179136 00010000:00010000:3.0:1787784769.909553:0:18944:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431bf501400/0xffb8d925c20bc18a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bc183 expref: 17 pid: 18954 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784769.909591:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787784769.909599:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17693f43-cfcf-4d1e-8495-73723b171a31+17:3294:x1874627643179136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784769.909609:0:18944:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784769.909614:0:18944:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431bf501400/0xffb8d925c20bc18a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bc183 expref: 17 pid: 18954 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784769.909636:0:18944:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431bf501400/0xffb8d925c20bc18a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20bc183 expref: 17 pid: 18954 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784769.909651:0:18944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf501400/0xffb8d925c20bc18a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20bc183 expref: 17 pid: 18954 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784769.909665:0:18944:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20bc21d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784769.909672:0:18944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20bc21d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787784769.909685:0:18944:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001679199s 00010000:00010000:3.0:1787784769.909689:0:18944:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20bc21d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784769.909696:0:18944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20bc21d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784769.909703:0:18944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20bc21d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784769.909710:0:18944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20bc21d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784769.909716:0:18944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1a00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784769.909720:0:18944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20bc21d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784769.909728:0:18944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20bc21d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784769.909758:0:18944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20bc21d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784769.909768:0:18944:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784769.909802:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17693f43-cfcf-4d1e-8495-73723b171a31+16:3294:x1874627643179136:12345-0@lo:103:ldlm_bl.0 Request processed in 204us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784769.909809:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787784769.909865:0:18975:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20bc21d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784769.909874:0:18975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20bc21d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784769.909880:0:18975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20bc21d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784769.909981:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17693f43-cfcf-4d1e-8495-73723b171a31:3294:1874627643179136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784769.918345:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+15:19642:x1874627643178880:12345-0@lo:253:mount.lustre.0 Request processed in 64377us (64527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784769.918361:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787784769.918511:0:19642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:19642:1874627643178880:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787784769.918528:0:19642:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787784769.918531:0:19642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787784769.918533:0:19642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787784769.918534:0:19642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784769.918536:0:19642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784769.918553:0:19642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784769.918554:0:19642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784769.918556:0:19642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787784769.918557:0:19642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784769.918559:0:19642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787784769.918575:0:19642:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787784769.919035:0:19642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787784769.919206:0:19642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787784769.919417:0:19642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787784769.919560:0:19642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787784769.919697:0:19642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787784769.919926:0:19642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787784769.927652:0:19642:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1787784770.041049:0:19642:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787784770.041059:0:19642:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787784770.041094:0:19642:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787784770.041153:0:19642:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.159@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787784770.041170:0:19642:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787784770.041206:0:19642:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787784770.043344:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784771.060562:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787784771.835969:0:18956:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787784771.835979:0:18956:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9430827c4800 from 10 10000000:01000000:3.0:1787784771.835984:0:18956:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787784771.836037:0:18956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf501400/0xffb8d925c20bc224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784771.836049:0:18956:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bf501400/0xffb8d925c20bc224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784771.836061:0:18956:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bf501400/0xffb8d925c20bc224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784771.836090:0:18956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643179264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784771.836166:0:18956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784771.836229:0:18956:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431908540c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784771.836293:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643179264 00000100:00100000:1.0:1787784771.836301:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643179264 00000100:00100000:1.0:1787784771.836356:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787784771.836393:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+15:18956:x1874627643179264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784771.836409:0:18953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784771.836423:0:18953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943181512600/0xffb8d925c20bc22b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bc224 expref: -99 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784771.836447:0:18953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943181512600/0xffb8d925c20bc22b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bc224 expref: 16 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784771.836459:0:18953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943181512600/0xffb8d925c20bc22b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc224 expref: 16 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784771.836489:0:18953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943181512600, rc 0) 00000100:00100000:1.0:1787784771.836531:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+16:18956:x1874627643179264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784771.836538:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787784771.836580:0:18956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643179264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784771.836594:0:18956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bf501400/0xffb8d925c20bc224 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc22b expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784771.836615:0:18956:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bf501400/0xffb8d925c20bc224 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bc22b expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784771.836666:0:18956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189160780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643179392:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787784771.836696:0:18956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784771.836714:0:18956:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787784771.836780:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643179392 00000100:00100000:0.0:1787784771.836784:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643179392 00000100:00100000:0.0:1787784771.836827:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787784771.836835:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+16:18956:x1874627643179392:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787784771.836849:0:18952:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787784771.836865:0:18952:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787784771.836869:0:18952:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1787784771.836952:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+16:18956:x1874627643179392:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784771.836959:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787784771.837168:0:18956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189160780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643179392:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787784771.837224:0:18956:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787784771.837231:0:18956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf501400/0xffb8d925c20bc224 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc22b expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784771.837239:0:18956:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bf501400/0xffb8d925c20bc224 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc22b expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784772.089579:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784773.109608:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784774.139087:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787784774.964545:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784774.964554:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784774.964557:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784774.964560:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787784774.964624:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643179776:0@lo:400:kworker.0 00000100:00100000:2.0:1787784774.964726:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784774.964839:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643179776 00000100:00100000:2.0:1787784774.964847:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643179776 00000100:00100000:2.0:1787784774.964907:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784774.964916:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643179776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784774.964972:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643179776:12345-0@lo:400:kworker.0 Request processed in 58us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784774.964979:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787784774.965010:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787784774.965047:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431b45b52c0 x1874627643179776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784774.965063:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643179776:0@lo:400:kworker.0 00000100:00100000:3.0:1787784774.965215:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17693f43-cfcf-4d1e-8495-73723b171a31:3295:1874627643179520:0@lo:400:kworker.0 00000100:00100000:3.0:1787784774.965253:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784774.965281:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787784774.965287:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643179648:0@lo:400:kworker.0 00000100:00100000:3.0:1787784774.965315:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784774.965358:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643179520 00000100:00100000:3.0:1787784774.965396:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643179520 00000100:00100000:3.0:1787784774.965427:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787784774.965435:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+16:3295:x1874627643179520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784774.965471:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+16:3295:x1874627643179520:12345-0@lo:400:kworker.0 Request processed in 38us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784774.965477:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787784774.965523:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17693f43-cfcf-4d1e-8495-73723b171a31:3295:1874627643179520:0@lo:400:kworker.0 00000100:00100000:2.0:1787784774.965656:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643179648 00000100:00100000:2.0:1787784774.965661:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643179648 00000100:00100000:2.0:1787784774.965693:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784774.965701:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643179648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784774.965738:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643179648:12345-0@lo:400:kworker.0 Request processed in 39us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784774.965744:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787784774.965815:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431b45b6d00 x1874627643179648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784774.965825:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643179648:0@lo:400:kworker.0 00010000:00010000:2.0:1787784775.163145:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784776.180529:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787784776.760635:0:18992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1787784777.073190:0:20012:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787784777.206506:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784778.230510:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784779.062044:0:3292:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784764/real 1787784764] req@ffff943189161680 x1874627643175552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784779 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784779.062084:0:3292:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff943189161680 x1874627643175552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784779 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784779.062095:0:3292:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784764/real 1787784764] req@ffff9431891621c0 x1874627643175680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784779 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784779.062123:0:3292:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9431891621c0 x1874627643175680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784779 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787784779.062142:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431bed64000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784779.062162:0:3292:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787784779.062167:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189161680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643175552:0@lo:8:kworker.0 00000100:00080000:2.0:1787784779.062172:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431b5c4d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784779.062177:0:3292:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787784779.062180:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431891621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643175680:0@lo:8:kworker.0 00000100:00080000:2.0:1787784779.062240:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784779.062243:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787784779.062245:0:38:0:(import.c:65:import_set_state_nolock()) ffff9431bed64000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787784779.062250:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 579 00000100:00080000:2.0:1787784779.062254:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787784779.062260:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9431bed64000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:2.0:1787784779.062278:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431b45b7840 x1874627643180032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787784779.062300:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784779.062303:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787784779.062305:0:38:0:(import.c:65:import_set_state_nolock()) ffff9431b5c4d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787784779.062308:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 579 00000100:00080000:2.0:1787784779.062310:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787784779.062314:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9431b5c4d800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:2.0:1787784779.062326:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431b45b52c0 x1874627643180160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787784779.062397:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17693f43-cfcf-4d1e-8495-73723b171a31:3294:1874627643179904:0@lo:400:kworker.0 00000100:00100000:2.0:1787784779.062459:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784779.062516:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643180288:0@lo:400:kworker.0 00000100:00100000:2.0:1787784779.062557:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784779.062577:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784779.062591:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643180416:0@lo:400:kworker.0 00000100:00100000:2.0:1787784779.062611:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784779.062640:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643179904 00000100:00100000:2.0:1787784779.062648:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643179904 00000100:00100000:2.0:1787784779.062691:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787784779.062700:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430826c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+16:3294:x1874627643179904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784779.062752:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430826c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+16:3294:x1874627643179904:12345-0@lo:400:kworker.0 Request processed in 43us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784779.062759:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787784779.062790:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643180288 00000100:00100000:2.0:1787784779.062794:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643180288 00000100:00100000:2.0:1787784779.062815:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643180416 00000100:00100000:2.0:1787784779.062818:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643180416 00000100:00100000:2.0:1787784779.062847:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787784779.062853:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643180288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784779.062887:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643180288:12345-0@lo:400:kworker.0 Request processed in 35us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784779.062892:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787784779.062902:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787784779.062907:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643180416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784779.062940:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643180416:12345-0@lo:400:kworker.0 Request processed in 33us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784779.062945:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787784779.062970:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787784779.062994:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431b45b61c0 x1874627643180416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784779.063005:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643180416:0@lo:400:kworker.0 00010000:00080000:2.0:1787784779.063013:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431b45b6d00 x1874627643180288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784779.063020:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643180288:0@lo:400:kworker.0 00000100:00100000:2.0:1787784779.063039:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17693f43-cfcf-4d1e-8495-73723b171a31:3294:1874627643179904:0@lo:400:kworker.0 00000100:00100000:2.0:1787784779.063050:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643180032:0@lo:8:kworker.0 00000100:00100000:2.0:1787784779.063072:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784779.063090:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643180160:0@lo:8:kworker.0 00000100:00100000:2.0:1787784779.063110:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784779.063332:0:19643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643180032 00000100:00100000:1.0:1787784779.063344:0:19643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643180032 00000100:00100000:1.0:1787784779.063389:0:19643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643180160 00000100:00100000:1.0:1787784779.063392:0:19643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643180160 00000100:00100000:1.0:1787784779.063404:0:19643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784779.063409:0:19643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3292:x1874627643180032:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787784779.063431:0:19643:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 593 last 0 00000020:00000080:1.0:1787784779.063462:0:19643:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xffb8d925c20bc232 00002000:00100000:1.0:1787784779.063475:0:19643:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9431b9fff000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113936 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787784779.063479:0:19643:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787784779.063482:0:19643:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787784779.064465:0:19643:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787784779.064495:0:19643:0:(import.c:65:import_set_state_nolock()) ffff9431b9ffd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784779.064574:0:19643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3292:x1874627643180032:12345-0@lo:8:kworker.0 Request processed in 1162us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784779.065020:0:19643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784779.065049:0:19643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784779.065054:0:19643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3292:x1874627643180160:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787784779.065080:0:19643:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1787784779.066075:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431b45b7840 x1874627643180032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787784799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784779.066089:0:3292:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787784779.066098:0:3292:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787784779.066107:0:3292:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787784779.066112:0:3292:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787784779.066116:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431bed64000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787784779.066143:0:3292:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787784779.066148:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643180032:0@lo:8:kworker.0 00000004:00080000:0.0:1787784779.067767:0:18982:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x22:0x0] 00000100:00100000:0.0:1787784779.067797:0:18982:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45aed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18982:1874627643180672:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787784779.069172:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643180544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784779.069217:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787784779.069462:0:18981:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1787784779.069687:0:18982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784779.069707:0:18982:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431857550c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784779.069732:0:19647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643180544 00000100:00100000:0.0:1787784779.069739:0:19647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643180544 00000100:00100000:2.0:1787784779.070180:0:19646:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787784779.070190:0:19646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787784779.070929:0:19647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784779.070957:0:19647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643180544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787784779.070995:0:19647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00080000:2.0:1787784779.071199:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784779.071246:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643180672 00000100:00100000:2.0:1787784779.071252:0:19646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643180672 00000100:00100000:2.0:1787784779.072206:0:20123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784779.072215:0:20123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:18982:x1874627643180672:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787784779.072416:0:19647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1874627643180544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1475us (3197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784779.072425:0:19647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:3.0:1787784779.074199:0:18981:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 593900831344ns, next at 0ns, rc = 0 00010000:00080000:0.0:1787784779.075156:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431b45af480 x1874627643180544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784779.075187:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643180544:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1787784779.098850:0:20123:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787784779.098861:0:20123:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1787784779.098866:0:20123:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:65) 00000100:00100000:1.0:1787784779.107781:0:19643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3292:x1874627643180160:12345-0@lo:8:kworker.0 Request processed in 42715us (44659us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787784779.107796:0:19643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787784779.124653:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431b5c4d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784779.124664:0:3292:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787784779.124669:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643180160:0@lo:8:kworker.0 00002000:00010000:2.0:1787784779.129484:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784779.129499:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc239 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.129517:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=593s v=(0 0) 00010000:00010000:2.0:1787784779.129522:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784779.129529:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc239 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.129548:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc239 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.129573:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc239 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.129582:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc239 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.129603:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784779.129618:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784779.129624:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc239 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.129634:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0200 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784779.129638:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc239 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.129647:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc239 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.129677:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc239 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.131130:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc239 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.131390:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784779.131400:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784779.131404:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784779.134599:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784779.134613:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bc240 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.134630:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=593s v=(0 0) 00010000:00010000:2.0:1787784779.134635:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784779.134642:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bc240 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.134669:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bc240 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.135350:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bc240 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.135388:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bc240 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.135416:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787784779.136058:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784779.136428:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bc240 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.136441:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1a00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784779.136446:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bc240 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.136477:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bc240 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.136503:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bc240 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.136512:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bc240 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.136533:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784779.136545:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784779.136547:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784779.138112:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784779.138124:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc247 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.138139:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=593s v=(0 0) 00010000:00010000:2.0:1787784779.138359:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784779.138384:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc247 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.138409:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc247 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.138420:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc247 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.138428:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc247 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.138446:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784779.138459:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784779.138465:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc247 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.138473:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1e00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784779.138477:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc247 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.138486:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc247 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.138500:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc247 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.138508:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc247 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.138530:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784779.138532:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784779.138534:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784779.141071:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784779.141084:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bc24e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.141101:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=593s v=(0 0) 00010000:00010000:2.0:1787784779.141105:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784779.141112:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bc24e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.141125:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bc24e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.141134:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bc24e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.141143:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bc24e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.141165:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787784779.141216:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784779.141225:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bc24e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.141235:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0e00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784779.141241:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bc24e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.141251:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bc24e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.141270:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bc24e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.141290:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bc24e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.141313:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784779.141316:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784779.141318:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784779.141808:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784779.141815:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bc255 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.141836:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=593s v=(0 0) 00010000:00010000:2.0:1787784779.141839:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784779.141843:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bc255 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.141853:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bc255 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.141862:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bc255 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.141869:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bc255 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.141896:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784779.143172:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784779.143184:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bc255 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.143196:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1800 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784779.143201:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bc255 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.143210:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bc255 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.143230:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bc255 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.143248:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bc255 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.143271:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.143274:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.143275:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784779.148461:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784779.148475:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc25c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.148494:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=593s v=(0 0) 00010000:00010000:2.0:1787784779.148500:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784779.148507:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc25c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.148524:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc25c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.148548:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc25c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.148557:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc25c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.150357:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787784779.151533:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784779.151545:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc263 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.151563:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=593s v=(0 0) 00010000:00010000:2.0:1787784779.151568:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784779.151575:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc263 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.151590:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc263 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.151601:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc263 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.151610:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc263 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.159200:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787784779.159219:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc25c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.159235:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1e00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784779.159240:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc25c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.159252:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc25c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.159278:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc25c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.159287:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc25c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.159320:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784779.159324:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc263 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.159347:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0200 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784779.159351:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc263 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.159359:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc263 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.159386:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc263 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.159394:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.159395:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.159397:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784779.162756:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787784779.162772:0:20123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc263 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.164504:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784779.168610:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784779.168627:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20bc26a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.168655:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=593s v=(0 0) 00010000:00010000:3.0:1787784779.168660:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784779.168667:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20bc26a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.168682:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20bc26a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.168710:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20bc26a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.168718:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20bc26a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.168737:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784779.168760:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784779.168767:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20bc26a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.168775:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500200 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784779.168779:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20bc26a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.168789:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20bc26a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.168807:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20bc26a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.168816:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20bc26a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.168835:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.168843:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.168845:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784779.170309:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784779.170321:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac51ee42/0xffb8d925c20bc271 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.170336:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=593s v=(0 0) 00010000:00010000:3.0:1787784779.170341:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784779.170347:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac51ee42/0xffb8d925c20bc271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.170359:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac51ee42/0xffb8d925c20bc271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.170405:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac51ee42/0xffb8d925c20bc271 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.170414:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac51ee42/0xffb8d925c20bc271 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.170452:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784779.170464:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784779.170470:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac51ee42/0xffb8d925c20bc271 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.170478:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500a00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784779.170482:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac51ee42/0xffb8d925c20bc271 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.170503:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac51ee42/0xffb8d925c20bc271 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.170520:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac51ee42/0xffb8d925c20bc271 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.170528:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac51ee42/0xffb8d925c20bc271 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.170557:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.170559:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.170561:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784779.183452:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784779.183465:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060b83d8c/0xffb8d925c20bc278 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.183481:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=593s v=(0 0) 00010000:00010000:3.0:1787784779.183486:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784779.183494:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060b83d8c/0xffb8d925c20bc278 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.183507:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060b83d8c/0xffb8d925c20bc278 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.183518:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060b83d8c/0xffb8d925c20bc278 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.183533:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060b83d8c/0xffb8d925c20bc278 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.183556:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784779.185391:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784779.185402:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e4b082c/0xffb8d925c20bc27f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.185416:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=593s v=(0 0) 00010000:00010000:3.0:1787784779.185420:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784779.185426:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e4b082c/0xffb8d925c20bc27f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.185437:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e4b082c/0xffb8d925c20bc27f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.185446:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e4b082c/0xffb8d925c20bc27f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.185453:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e4b082c/0xffb8d925c20bc27f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.185478:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787784779.185942:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787784779.185960:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060b83d8c/0xffb8d925c20bc278 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784779.185970:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501a00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784779.185974:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060b83d8c/0xffb8d925c20bc278 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784779.185984:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060b83d8c/0xffb8d925c20bc278 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784779.186015:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060b83d8c/0xffb8d925c20bc278 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784779.186023:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060b83d8c/0xffb8d925c20bc278 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784779.186058:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784779.186062:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e4b082c/0xffb8d925c20bc27f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784779.186069:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501800 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784779.186072:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e4b082c/0xffb8d925c20bc27f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784779.186080:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e4b082c/0xffb8d925c20bc27f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784779.186091:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e4b082c/0xffb8d925c20bc27f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784779.186099:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e4b082c/0xffb8d925c20bc27f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784779.186111:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784779.186112:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784779.186114:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784779.186467:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784779.191098:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784779.191113:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc286 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.191139:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=593s v=(0 0) 00010000:00010000:3.0:1787784779.191143:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784779.191151:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.191165:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.191174:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc286 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.191181:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc286 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.191214:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784779.191667:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784779.191672:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc28d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.191680:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=593s v=(0 0) 00010000:00010000:3.0:1787784779.191684:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784779.191688:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc28d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.191697:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc28d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.191715:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc28d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.191721:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc28d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.191732:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787784779.192008:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784779.192017:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc286 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.192026:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500e00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784779.192032:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc286 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.192043:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc286 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787784779.192053:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1787784779.192067:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc286 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.192077:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc286 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.192099:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784779.192103:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc28d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.192117:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501c00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784779.192121:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc28d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.192129:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc28d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.192141:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc28d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.192148:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc28d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.192163:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784779.192165:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784779.192167:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784779.192174:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784779.196892:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784779.196905:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f349d3/0xffb8d925c20bc294 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.196921:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=594s v=(0 0) 00010000:00010000:3.0:1787784779.196925:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784779.196931:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f349d3/0xffb8d925c20bc294 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.196944:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9f349d3/0xffb8d925c20bc294 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.196954:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f349d3/0xffb8d925c20bc294 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.196963:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f349d3/0xffb8d925c20bc294 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.196996:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784779.197465:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784779.197472:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb4b97b4/0xffb8d925c20bc29b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.197482:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=594s v=(0 0) 00010000:00010000:3.0:1787784779.197488:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784779.197492:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb4b97b4/0xffb8d925c20bc29b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.197501:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb4b97b4/0xffb8d925c20bc29b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.197509:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb4b97b4/0xffb8d925c20bc29b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.197516:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb4b97b4/0xffb8d925c20bc29b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.197585:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787784779.197614:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784779.197623:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9f349d3/0xffb8d925c20bc294 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.197631:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784779.197635:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f349d3/0xffb8d925c20bc294 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.197658:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f349d3/0xffb8d925c20bc294 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.197680:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9f349d3/0xffb8d925c20bc294 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.197688:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9f349d3/0xffb8d925c20bc294 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.197713:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784779.197717:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb4b97b4/0xffb8d925c20bc29b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.197725:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500c00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784779.197728:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb4b97b4/0xffb8d925c20bc29b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.197736:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb4b97b4/0xffb8d925c20bc29b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.197760:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb4b97b4/0xffb8d925c20bc29b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.197767:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb4b97b4/0xffb8d925c20bc29b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784779.197797:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784779.197801:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784779.197803:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784779.198045:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784779.198052:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bc2a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.198062:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1787784779.198065:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784779.198070:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bc2a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.198081:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bc2a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.198212:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bc2a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.198220:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bc2a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.198236:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784779.198252:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784779.198257:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bc2a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.198264:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1c00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784779.198267:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bc2a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.198275:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bc2a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.198285:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bc2a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.198292:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bc2a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.198306:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784779.198308:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784779.198310:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.198547:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784779.198958:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784779.198965:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc2a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.198975:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1787784779.198979:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784779.198984:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc2a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.199008:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc2a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.199017:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc2a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.199025:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc2a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.199547:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784779.199557:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784779.199562:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc2a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.199569:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0200 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784779.199572:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc2a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.199580:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc2a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.199593:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc2a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.199600:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bc2a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.199623:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784779.199626:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784779.199627:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784779.200081:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784779.201471:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1682694/0xffb8d925c20bc2b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.201490:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1787784779.201494:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784779.201501:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1682694/0xffb8d925c20bc2b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.201515:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1682694/0xffb8d925c20bc2b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.201527:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1682694/0xffb8d925c20bc2b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.201535:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1682694/0xffb8d925c20bc2b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.201562:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787784779.202423:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784779.202431:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7f51c08/0xffb8d925c20bc2b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.202455:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1787784779.202459:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784779.202464:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7f51c08/0xffb8d925c20bc2b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.202474:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7f51c08/0xffb8d925c20bc2b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.202484:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7f51c08/0xffb8d925c20bc2b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.202491:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7f51c08/0xffb8d925c20bc2b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.202506:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787784779.202516:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784779.202521:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1682694/0xffb8d925c20bc2b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.202529:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0000 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784779.202533:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1682694/0xffb8d925c20bc2b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.202543:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1682694/0xffb8d925c20bc2b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.202571:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1682694/0xffb8d925c20bc2b0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.202580:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1682694/0xffb8d925c20bc2b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.202598:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784779.202602:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7f51c08/0xffb8d925c20bc2b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.202610:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0a00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784779.202613:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7f51c08/0xffb8d925c20bc2b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.202621:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7f51c08/0xffb8d925c20bc2b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.202632:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7f51c08/0xffb8d925c20bc2b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.202639:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7f51c08/0xffb8d925c20bc2b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.202651:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784779.202653:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784779.202661:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.202696:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784779.203515:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784779.203523:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bc2be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.203536:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1787784779.203540:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784779.203544:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bc2be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.203554:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bc2be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.203563:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bc2be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.203571:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bc2be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.203591:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784779.203707:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784779.203715:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bc2be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.203726:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784779.203739:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bc2be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.203760:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bc2be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.203776:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bc2be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.203784:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bc2be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.203804:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.203807:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.203808:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784779.204026:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784779.204033:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a73fb56/0xffb8d925c20bc2c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.204041:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1787784779.204044:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784779.204048:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a73fb56/0xffb8d925c20bc2c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.204066:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a73fb56/0xffb8d925c20bc2c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.204074:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a73fb56/0xffb8d925c20bc2c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.204081:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a73fb56/0xffb8d925c20bc2c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.204722:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784779.204790:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784779.204797:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a73fb56/0xffb8d925c20bc2c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.204807:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784779.204811:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a73fb56/0xffb8d925c20bc2c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.204820:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a73fb56/0xffb8d925c20bc2c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.204834:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a73fb56/0xffb8d925c20bc2c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.204850:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a73fb56/0xffb8d925c20bc2c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.204867:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.204870:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.204871:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784779.205553:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784779.205562:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bc2cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.205573:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1787784779.205577:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784779.205583:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bc2cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.205594:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bc2cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.205603:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bc2cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.205623:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bc2cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.205642:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787784779.206033:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784779.206038:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc2d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.206046:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1787784779.206049:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784779.206052:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc2d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.206062:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc2d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.206069:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc2d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.206076:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc2d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.206419:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787784779.206701:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787784779.206710:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bc2cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.206720:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784779.206725:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bc2cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.206734:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bc2cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.206760:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bc2cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.206768:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bc2cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.206788:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784779.206791:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc2d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.206804:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1e00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784779.206808:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc2d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.206817:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc2d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.206828:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc2d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787784779.206833:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784779.206836:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc2d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.206843:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bc2da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.206851:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.206854:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.206857:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.206864:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784779.206865:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1787784779.206871:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784779.206876:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bc2da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.206886:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bc2da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.206894:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bc2da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.206901:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bc2da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.206923:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784779.206958:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784779.206964:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bc2da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.206972:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1800 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784779.206975:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bc2da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.206994:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bc2da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.207006:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bc2da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.207015:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bc2da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.207031:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.207033:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.207035:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784779.208546:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784779.208556:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bc2e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.208569:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1787784779.208574:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784779.208580:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bc2e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.208591:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bc2e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.208617:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bc2e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.208625:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bc2e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.208651:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784779.208683:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784779.208691:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bc2e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.208701:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0e00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784779.208706:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bc2e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.208716:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bc2e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.208731:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bc2e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.208762:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bc2e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.208778:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.208780:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.208782:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784779.209267:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784779.209273:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bc2e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.209283:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1787784779.209286:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784779.209291:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bc2e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.209300:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bc2e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.209308:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bc2e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.209316:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bc2e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.209347:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784779.209407:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784779.209414:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bc2e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.209424:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1a00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784779.209428:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bc2e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.209438:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bc2e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.209452:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bc2e8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.209459:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bc2e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.209481:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.209483:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.209487:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784779.209796:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784779.209803:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a05dedd/0xffb8d925c20bc2ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.209811:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1787784779.209815:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784779.209819:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a05dedd/0xffb8d925c20bc2ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.209829:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a05dedd/0xffb8d925c20bc2ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.209838:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a05dedd/0xffb8d925c20bc2ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.209845:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a05dedd/0xffb8d925c20bc2ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.209867:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784779.210481:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784779.210488:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a05dedd/0xffb8d925c20bc2ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.210497:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431be794800 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784779.210501:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a05dedd/0xffb8d925c20bc2ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.210510:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a05dedd/0xffb8d925c20bc2ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.210524:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a05dedd/0xffb8d925c20bc2ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.210532:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a05dedd/0xffb8d925c20bc2ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.210558:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.210560:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.210562:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784779.211793:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784779.211803:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c3f80d4/0xffb8d925c20bc2f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.211816:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1787784779.211825:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784779.211831:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c3f80d4/0xffb8d925c20bc2f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.211843:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c3f80d4/0xffb8d925c20bc2f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.211851:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c3f80d4/0xffb8d925c20bc2f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.211857:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c3f80d4/0xffb8d925c20bc2f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.211881:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784779.212208:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784779.212215:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c3f80d4/0xffb8d925c20bc2f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.212224:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431be795000 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784779.212228:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c3f80d4/0xffb8d925c20bc2f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.212250:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c3f80d4/0xffb8d925c20bc2f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.212266:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c3f80d4/0xffb8d925c20bc2f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.212273:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c3f80d4/0xffb8d925c20bc2f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.212292:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.212294:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.212296:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784779.213761:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784779.213775:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d5e19f/0xffb8d925c20bc2fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.213788:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1787784779.213792:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784779.213798:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d5e19f/0xffb8d925c20bc2fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.213810:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d5e19f/0xffb8d925c20bc2fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.213818:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d5e19f/0xffb8d925c20bc2fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.213834:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d5e19f/0xffb8d925c20bc2fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.213861:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784779.214000:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784779.214008:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d5e19f/0xffb8d925c20bc2fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.214017:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431be795400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784779.214021:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d5e19f/0xffb8d925c20bc2fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.214030:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d5e19f/0xffb8d925c20bc2fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.214045:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d5e19f/0xffb8d925c20bc2fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.214064:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d5e19f/0xffb8d925c20bc2fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.214086:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.214088:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.214090:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784779.215037:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784779.215045:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c279688/0xffb8d925c20bc304 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.215057:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1787784779.215061:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784779.215065:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c279688/0xffb8d925c20bc304 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.215076:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c279688/0xffb8d925c20bc304 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.215773:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c279688/0xffb8d925c20bc304 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.215784:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c279688/0xffb8d925c20bc304 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.215809:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784779.216640:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784779.216648:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c279688/0xffb8d925c20bc304 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.216659:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431be795c00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784779.216663:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c279688/0xffb8d925c20bc304 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.216672:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c279688/0xffb8d925c20bc304 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.216688:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c279688/0xffb8d925c20bc304 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.216695:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c279688/0xffb8d925c20bc304 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.216716:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.216717:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.216719:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784779.217511:0:20123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784779.217520:0:20123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e97c0f8/0xffb8d925c20bc30b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.217538:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1787784779.217542:0:20123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784779.217548:0:20123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e97c0f8/0xffb8d925c20bc30b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.217560:0:20123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e97c0f8/0xffb8d925c20bc30b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.217568:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e97c0f8/0xffb8d925c20bc30b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.217575:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e97c0f8/0xffb8d925c20bc30b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784779.217601:0:20123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784779.217702:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784779.217709:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e97c0f8/0xffb8d925c20bc30b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.217719:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431be794600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784779.217723:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e97c0f8/0xffb8d925c20bc30b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.217731:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e97c0f8/0xffb8d925c20bc30b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.217755:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e97c0f8/0xffb8d925c20bc30b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.217763:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e97c0f8/0xffb8d925c20bc30b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784779.217783:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.217785:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784779.217788:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787784779.217834:0:20123:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:34 00000100:00100000:2.0:1787784779.217931:0:20123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18982:x1874627643180672:12345-0@lo:5:osp-pre-0-0.0 Request processed in 145714us (148241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784779.217941:0:20123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787784779.218446:0:18982:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45aed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18982:1874627643180672:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787784779.218462:0:18982:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x22:0x0] 00000100:00100000:0.0:1787784779.218508:0:18982:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45aed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18982:1874627643180800:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787784779.218555:0:18982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784779.218614:0:18982:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431857550c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784779.219326:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643180800 00000100:00100000:2.0:1787784779.219334:0:19646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643180800 00000100:00100000:2.0:1787784779.219399:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784779.219408:0:19646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18982:x1874627643180800:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787784779.219452:0:19646:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00000100:00100000:2.0:1787784779.228056:0:19646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:18982:x1874627643180800:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8642us (9493us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1787784779.228078:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787784779.229853:0:18982:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45aed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18982:1874627643180800:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787784779.229872:0:18982:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00010000:00010000:3.0:1787784779.255414:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787784780.167607:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787784780.167624:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00010000:00010000:3.0:1787784780.277108:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784781.302821:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784782.329890:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784783.350567:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787784784.180647:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784784.180654:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787784784.180658:0:475:0:(import.c:65:import_set_state_nolock()) ffff9431b5c4d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787784784.180665:0:475:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 593 00000100:00080000:2.0:1787784784.180671:0:475:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787784784.180678:0:475:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9431b5c4d800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:2.0:1787784784.180714:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94319206da40 x1874627643181184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787784784.180769:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643181056:0@lo:400:kworker.0 00000100:00100000:2.0:1787784784.180834:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784784.180891:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784784.180897:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319206f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643181312:0@lo:400:kworker.0 00000100:00100000:2.0:1787784784.180921:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784784.180949:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319206da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643181184:0@lo:8:kworker.0 00000100:00100000:2.0:1787784784.180970:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784784.181004:0:19643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643181056 00000100:00100000:2.0:1787784784.181011:0:19643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643181056 00000100:00100000:2.0:1787784784.181056:0:19643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643181184 00000100:00100000:2.0:1787784784.181059:0:19643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643181184 00000100:00100000:2.0:1787784784.181073:0:19643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787784784.181080:0:19643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643181056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784784.181124:0:19643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643181056:12345-0@lo:400:kworker.0 Request processed in 45us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784784.181139:0:19643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787784784.181156:0:19643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787784784.181161:0:19643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3292:x1874627643181184:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787784784.181177:0:19643:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787784784.181454:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17693f43-cfcf-4d1e-8495-73723b171a31:3294:1874627643180928:0@lo:400:kworker.0 00000100:00100000:3.0:1787784784.181488:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784784.181511:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787784784.181523:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319206c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1874627643181440:0@lo:400:kworker.0 00000100:00100000:3.0:1787784784.181549:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784784.181586:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643180928 00000100:00100000:3.0:1787784784.181589:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643180928 00000100:00100000:3.0:1787784784.181617:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787784784.181623:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430826c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+16:3294:x1874627643180928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784784.181668:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430826c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+16:3294:x1874627643180928:12345-0@lo:400:kworker.0 Request processed in 45us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784784.181674:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787784784.181869:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17693f43-cfcf-4d1e-8495-73723b171a31:3294:1874627643180928:0@lo:400:kworker.0 00000100:00100000:0.0:1787784784.182169:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784784.182181:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643181568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784784.182214:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784784.182332:0:19647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643181568 00000100:00100000:3.0:1787784784.182337:0:19647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643181568 00000100:00100000:3.0:1787784784.182384:0:19647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787784784.182393:0:19647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643181568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784784.182419:0:19647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1787784784.182522:0:19647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643181568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784784.182530:0:19647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784784.182679:0:3293:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1787784784.182773:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643181568:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787784784.187671:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784784.187728:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643181312 00000100:00100000:3.0:1787784784.187740:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643181312 00000100:00100000:3.0:1787784784.187794:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643181440 00000100:00100000:3.0:1787784784.187798:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643181440 00000100:00100000:3.0:1787784784.187832:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787784784.187842:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643181312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784784.187936:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643181312:12345-0@lo:400:kworker.0 Request processed in 96us (7013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784784.187955:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787784784.187974:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787784784.187981:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874627643181440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784784.188020:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874627643181440:12345-0@lo:400:kworker.0 Request processed in 40us (6470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784784.188027:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787784784.188070:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94319206c000 x1874627643181440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784784.188087:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319206c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1874627643181440:0@lo:400:kworker.0 00000100:00080000:3.0:1787784784.188118:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787784784.204905:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94319206f840 x1874627643181312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784784.204924:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319206f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643181312:0@lo:400:kworker.0 00000100:00100000:0.0:1787784784.204938:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643181056:0@lo:400:kworker.0 00000100:00100000:2.0:1787784784.212075:0:19643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3292:x1874627643181184:12345-0@lo:8:kworker.0 Request processed in 30902us (31092us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787784784.212093:0:19643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787784784.212163:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431b5c4d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784784.212169:0:3292:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787784784.212174:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319206da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643181184:0@lo:8:kworker.0 00010000:00010000:3.0:1787784784.376215:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787784785.005737:0:20366:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787784785.005741:0:20366:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787784785.005843:0:20366:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9431be3c4800 00000020:01000004:2.0:1787784785.005860:0:20366:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787784785.005873:0:20366:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787784785.005886:0:20366:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9431857e4d28) 00000020:00000080:2.0:1787784785.005901:0:20366:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787784785.035303:0:20366:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787784785.035839:0:20366:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787784785.038585:0:20366:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787784785.039020:0:20366:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1787784785.039475:0:20366:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:1.0:1787784785.040132:0:20366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 223: rc = 0 00100000:10000000:1.0:1787784785.040467:0:20366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 223: rc = 0 00100000:10000000:1.0:1787784785.040573:0:20366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 223: rc = 0 00100000:10000000:1.0:1787784785.041274:0:20366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 436: rc = 0 00100000:10000000:1.0:1787784785.041579:0:20366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 436: rc = 0 00100000:10000000:1.0:1787784785.041922:0:20366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 436: rc = 0 00100000:10000000:1.0:1787784785.042259:0:20366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 436: rc = 0 00100000:10000000:1.0:1787784785.042719:0:20366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 436: rc = 0 00100000:10000000:1.0:1787784785.043054:0:20366:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 436: rc = 0 00000020:00000080:1.0:1787784785.045788:0:20366:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787784785.045803:0:20366:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787784785.045816:0:20366:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xffb8d925c20bc319 00000020:01000004:1.0:1787784785.045826:0:20366:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1787784785.045848:0:20366:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.159@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787784785.045860:0:20366:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787784785.045867:0:20366:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787784785.045892:0:20366:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1787784785.045896:0:20366:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.159@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787784785.055749:0:20366:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.159@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787784785.055799:0:20366:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.159@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1787784785.055805:0:20366:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787784785.055806:0:20366:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787784785.055808:0:20366:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784785.055809:0:20366:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784785.055811:0:20366:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784785.055812:0:20366:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784785.055813:0:20366:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787784785.055815:0:20366:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784785.055816:0:20366:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787784785.055820:0:20366:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1787784785.055823:0:20366:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787784785.055824:0:20366:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787784785.055825:0:20366:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784785.055826:0:20366:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784785.055827:0:20366:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784785.055828:0:20366:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784785.055829:0:20366:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787784785.055830:0:20366:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784785.055831:0:20366:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787784785.055858:0:20366:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787784785.055881:0:20366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643181696:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787784785.056299:0:20366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784785.056603:0:20366:0:(client.c:2715:ptlrpc_set_wait()) set ffff943189091180 going to sleep for 11 seconds 00000100:00100000:2.0:1787784785.056868:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643181696 00000100:00100000:2.0:1787784785.056877:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643181696 00000100:00100000:2.0:1787784785.056935:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787784785.056955:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430826c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+16:20366:x1874627643181696:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787784785.057007:0:18952:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787784785.057011:0:18952:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787784785.057015:0:18952:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787784785.064540:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430826c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+16:20366:x1874627643181696:12345-0@lo:253:mount.lustre.0 Request processed in 7581us (8235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784785.064554:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787784785.064750:0:20366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643181696:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787784785.064764:0:20366:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787784785.064766:0:20366:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787784785.064767:0:20366:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787784785.064768:0:20366:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784785.064769:0:20366:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784785.064775:0:20366:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784785.064776:0:20366:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784785.064777:0:20366:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787784785.064779:0:20366:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784785.064779:0:20366:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787784785.064799:0:20366:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9431be3c4800 from lustre-OST0001 10000000:01000000:1.0:1787784785.064825:0:20366:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787784785.064828:0:20366:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787784785.064834:0:20366:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9431885e3370 local copy 00010000:00010000:1.0:1787784785.064842:0:20366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bee89c00/0xffb8d925c20bc0aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc0b1 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784785.065088:0:20366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643181824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784785.065115:0:20366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784785.065190:0:20366:0:(client.c:2715:ptlrpc_set_wait()) set ffff943189091240 going to sleep for 11 seconds 00000100:00100000:0.0:1787784785.065300:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643181824 00000100:00100000:0.0:1787784785.065307:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643181824 00000100:00100000:0.0:1787784785.065453:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787784785.065463:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430826c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+16:20366:x1874627643181824:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784785.065735:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430826c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+16:20366:x1874627643181824:12345-0@lo:501:mount.lustre.0 Request processed in 273us (617us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787784785.065743:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787784785.065796:0:20366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643181824:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787784785.065806:0:20366:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787784785.065900:0:20366:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787784785.065906:0:20366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bee89c00/0xffb8d925c20bc0aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc0b1 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784785.065913:0:20366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bee89c00/0xffb8d925c20bc0aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc0b1 expref: -99 pid: 18941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784785.065928:0:20366:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9431be3c4800 10000000:01000000:1.0:1787784785.065931:0:20366:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787784785.065934:0:20366:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787784785.065935:0:20366:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787784785.065948:0:20366:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787784785.065951:0:20366:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787784785.065973:0:20366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d1400/0xffb8d925c20bc320 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784785.065988:0:20366:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431829d1400/0xffb8d925c20bc320 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784785.065997:0:20366:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431829d1400/0xffb8d925c20bc320 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784785.066011:0:20366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643181952:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787784785.066032:0:20366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784785.066875:0:20366:0:(client.c:2715:ptlrpc_set_wait()) set ffff943189091240 going to sleep for 11 seconds 00000100:00100000:3.0:1787784785.066948:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643181952 00000100:00100000:3.0:1787784785.066954:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643181952 00000100:00100000:3.0:1787784785.066987:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787784785.066996:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430826c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+16:20366:x1874627643181952:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784785.067006:0:18953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784785.067020:0:18953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf500200/0xffb8d925c20bc327 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bc320 expref: -99 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784785.067039:0:18953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf500200/0xffb8d925c20bc327 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bc320 expref: 17 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784785.067047:0:18953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf500200/0xffb8d925c20bc327 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc320 expref: 17 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784785.067053:0:18953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500200, rc 0) 00000100:00100000:3.0:1787784785.067091:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430826c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+17:20366:x1874627643181952:12345-0@lo:101:mount.lustre.0 Request processed in 98us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784785.067104:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787784785.067268:0:20366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643181952:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784785.067283:0:20366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431829d1400/0xffb8d925c20bc320 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc327 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784785.067291:0:20366:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431829d1400/0xffb8d925c20bc320 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bc327 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787784785.068045:0:20366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1787784785.068886:0:20366:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787784785.069104:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787784785.069132:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1787784785.069164:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1787784785.069190:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1787784785.069208:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1787784785.069223:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1787784785.069255:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1787784785.069291:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1787784785.069321:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1787784785.069349:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1787784785.069360:0:20366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1787784785.069455:0:20366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643182080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784785.069505:0:20366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784785.069543:0:20366:0:(client.c:2715:ptlrpc_set_wait()) set ffff943189091540 going to sleep for 11 seconds 00000100:00100000:3.0:1787784785.069745:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643182080 00000100:00100000:3.0:1787784785.069752:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643182080 00000100:00100000:3.0:1787784785.069801:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787784785.069810:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430826c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+17:20366:x1874627643182080:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784785.070256:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430826c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+17:20366:x1874627643182080:12345-0@lo:501:mount.lustre.0 Request processed in 447us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784785.070264:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787784785.070406:0:20366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643182080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784785.070445:0:20366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643182208:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784785.070475:0:20366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784785.070497:0:20366:0:(client.c:2715:ptlrpc_set_wait()) set ffff943189091540 going to sleep for 11 seconds 00000100:00100000:2.0:1787784785.070515:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643182208 00000100:00100000:2.0:1787784785.070520:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643182208 00000100:00100000:2.0:1787784785.070547:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787784785.070565:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430826c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+17:20366:x1874627643182208:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787784785.070823:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430826c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+17:20366:x1874627643182208:12345-0@lo:503:mount.lustre.0 Request processed in 268us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784785.070830:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787784785.070846:0:20366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643182208:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787784785.071521:0:20366:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787784785.071576:0:20366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643182336:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784785.071623:0:20366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784785.071681:0:20366:0:(client.c:2715:ptlrpc_set_wait()) set ffff943189091540 going to sleep for 11 seconds 00000100:00100000:3.0:1787784785.071723:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643182336 00000100:00100000:3.0:1787784785.071728:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643182336 00000100:00100000:3.0:1787784785.071765:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787784785.071771:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430826c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+17:20366:x1874627643182336:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784785.071922:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430826c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+17:20366:x1874627643182336:12345-0@lo:502:mount.lustre.0 Request processed in 152us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784785.071927:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787784785.072081:0:20366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643182336:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787784785.072262:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1787784785.072306:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1787784785.072341:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1787784785.072450:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1787784785.072473:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1787784785.072502:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1787784785.072528:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1787784785.072546:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1787784785.072583:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1787784785.072610:0:20366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643182464:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784785.072659:0:20366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784785.072697:0:20366:0:(client.c:2715:ptlrpc_set_wait()) set ffff943189091540 going to sleep for 11 seconds 00000100:00100000:2.0:1787784785.072715:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643182464 00000100:00100000:2.0:1787784785.072719:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643182464 00000100:00100000:2.0:1787784785.072757:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787784785.072764:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430826c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+17:20366:x1874627643182464:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784785.072908:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430826c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+17:20366:x1874627643182464:12345-0@lo:502:mount.lustre.0 Request processed in 144us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784785.072915:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787784785.073033:0:20366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643182464:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787784785.073075:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1787784785.073081:0:20366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1787784785.074037:0:20367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787784785.074046:0:20367:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787784785.074053:0:20367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784785.074056:0:20367:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787784785.074061:0:20367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787784785.074078:0:20367:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9431b6263370) 00000020:00000080:1.0:1787784785.074098:0:20367:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787784785.074102:0:20367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787784785.074168:0:20367:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9431be3c4800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787784785.074176:0:20367:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787784785.074183:0:20367:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xffb8d925c20bc335 00010000:00010000:1.0:1787784785.077356:0:20367:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1787784785.078120:0:20367:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934593 00080000:10000000:1.0:1787784785.079562:0:20367:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1787784785.080973:0:20367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787784785.080986:0:20367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784785.080992:0:20367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784785.080995:0:20367:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787784785.080998:0:20367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784785.081001:0:20367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784785.081003:0:20367:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787784785.081006:0:20367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787784785.081008:0:20367:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787784785.081010:0:20367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784785.081013:0:20367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784785.081014:0:20367:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787784785.081016:0:20367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784785.081018:0:20367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784785.081020:0:20367:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787784785.081031:0:20367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787784785.081087:0:20367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784785.081090:0:20367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784785.081092:0:20367:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787784785.081095:0:20367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1787784785.081253:0:20366:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787784785.081280:0:20366:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787784785.081301:0:20366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d1400/0xffb8d925c20bc320 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc327 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784785.081313:0:20366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431829d1400/0xffb8d925c20bc320 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc327 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784785.081321:0:20366:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9431be3c4800 from 1 10000000:01000000:2.0:1787784785.081323:0:20366:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787784785.081356:0:20366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431be795800/0xffb8d925c20bc33c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784785.081389:0:20366:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431be795800/0xffb8d925c20bc33c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784785.081408:0:20366:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431be795800/0xffb8d925c20bc33c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784785.081432:0:20366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319206da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643182592:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787784785.081502:0:20366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784785.081785:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643182592 00000100:00100000:3.0:1787784785.081794:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643182592 00000100:00100000:3.0:1787784785.081848:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787784785.081858:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430826c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+17:20366:x1874627643182592:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784785.081871:0:18954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784785.081884:0:18954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf500a00/0xffb8d925c20bc343 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bc33c expref: -99 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784785.081907:0:18954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf500a00/0xffb8d925c20bc343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bc33c expref: 18 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784785.081917:0:18954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf500a00/0xffb8d925c20bc343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc33c expref: 18 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784785.081933:0:18954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500a00, rc 0) 00000100:00100000:3.0:1787784785.081971:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430826c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+18:20366:x1874627643182592:12345-0@lo:101:mount.lustre.0 Request processed in 115us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784785.081978:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787784785.082061:0:20366:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185755300 going to sleep for 11 seconds 00000100:00100000:2.0:1787784785.082086:0:20366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319206da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643182592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784785.082101:0:20366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431be795800/0xffb8d925c20bc33c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc343 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784785.082110:0:20366:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431be795800/0xffb8d925c20bc33c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bc343 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787784785.083127:0:20366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:2.0:1787784785.085178:0:20366:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784785.086291:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1787784785.086352:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1787784785.086441:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1787784785.086480:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1787784785.086516:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1787784785.086577:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1787784785.086701:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1787784785.086740:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1787784785.086814:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1787784785.086821:0:20366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:2.0:1787784785.086912:0:20366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319206da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643182720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784785.086976:0:20366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784785.087031:0:20366:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185755300 going to sleep for 11 seconds 00000100:00100000:3.0:1787784785.087832:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643182720 00000100:00100000:3.0:1787784785.087841:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643182720 00000100:00100000:3.0:1787784785.087891:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787784785.087900:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430826c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+18:20366:x1874627643182720:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784785.088147:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430826c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+18:20366:x1874627643182720:12345-0@lo:501:mount.lustre.0 Request processed in 247us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784785.088156:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787784785.088419:0:20366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319206da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643182720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784785.088460:0:20366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319206da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643182848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787784785.088504:0:20366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784785.088527:0:20366:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185755300 going to sleep for 11 seconds 00000100:00100000:3.0:1787784785.088640:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643182848 00000100:00100000:3.0:1787784785.088645:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643182848 00000100:00100000:3.0:1787784785.088673:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787784785.088680:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+18:20366:x1874627643182848:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787784785.088951:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+18:20366:x1874627643182848:12345-0@lo:503:mount.lustre.0 Request processed in 271us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784785.088958:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787784785.089162:0:20366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319206da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643182848:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787784785.089851:0:20366:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787784785.089928:0:20366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319206da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643182976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784785.089975:0:20366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784785.090050:0:20366:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185755300 going to sleep for 11 seconds 00000100:00100000:0.0:1787784785.092781:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643182976 00000100:00100000:0.0:1787784785.092795:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643182976 00000100:00100000:0.0:1787784785.092910:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787784785.092921:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+18:20366:x1874627643182976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784785.093240:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+18:20366:x1874627643182976:12345-0@lo:502:mount.lustre.0 Request processed in 320us (3263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784785.093249:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787784785.093343:0:20366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319206da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643182976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787784785.094791:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1787784785.094857:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1787784785.094891:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1787784785.094916:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1787784785.094938:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1787784785.094999:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1787784785.095040:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1787784785.095073:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:2.0:1787784785.095118:0:20366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319206da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643183104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784785.095187:0:20366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784785.097853:0:20366:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185755300 going to sleep for 11 seconds 00000100:00100000:3.0:1787784785.098106:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643183104 00000100:00100000:3.0:1787784785.098116:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643183104 00000100:00100000:3.0:1787784785.098177:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787784785.098187:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+18:20366:x1874627643183104:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784785.098673:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+18:20366:x1874627643183104:12345-0@lo:502:mount.lustre.0 Request processed in 487us (3486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784785.098682:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787784785.098882:0:20366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319206da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643183104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787784785.099225:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1787784785.099414:0:20366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787784785.100741:0:20371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784785.100754:0:20371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784785.100769:0:20371:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787784785.100779:0:20371:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9431be3c4800 00000020:00000080:2.0:1787784785.100781:0:20371:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787784785.100790:0:20371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784785.100792:0:20371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784785.100793:0:20371:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787784785.100796:0:20371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784785.100799:0:20371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784785.100800:0:20371:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787784785.100804:0:20371:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9431be3c4800 00000020:00000080:2.0:1787784785.100806:0:20371:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787784785.100873:0:20371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784785.100877:0:20371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784785.100879:0:20371:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787784785.100881:0:20371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784785.100884:0:20371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784785.100885:0:20371:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787784785.100889:0:20371:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9431be3c4800 00000020:00000080:2.0:1787784785.100891:0:20371:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787784785.100929:0:20371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784785.100933:0:20371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784785.100935:0:20371:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787784785.101077:0:20371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:3.0:1787784785.102812:0:20366:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787784785.102853:0:20366:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787784785.102880:0:20366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431be795800/0xffb8d925c20bc33c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc343 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784785.102895:0:20366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431be795800/0xffb8d925c20bc33c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc343 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784785.102962:0:20366:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787784785.102965:0:20366:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9431be3c4800 10000000:01000000:3.0:1787784785.103002:0:20366:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9431be3c4800 10000000:01000000:3.0:1787784785.103009:0:20366:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787784785.103034:0:20366:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9431be3c4800 from 1 10000000:01000000:3.0:1787784785.103037:0:20366:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787784785.103080:0:20366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf501200/0xffb8d925c20bc34a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784785.103089:0:20366:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bf501200/0xffb8d925c20bc34a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784785.103100:0:20366:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bf501200/0xffb8d925c20bc34a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784785.103124:0:20366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643183232:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787784785.103201:0:20366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784785.103246:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643183232 00000100:00100000:3.0:1787784785.103253:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643183232 00000100:00100000:3.0:1787784785.103296:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787784785.103306:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+18:20366:x1874627643183232:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784785.103319:0:18953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784785.103340:0:18953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf501800/0xffb8d925c20bc351 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bc34a expref: -99 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784785.103395:0:18953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf501800/0xffb8d925c20bc351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bc34a expref: 19 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784785.103407:0:18953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf501800/0xffb8d925c20bc351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc34a expref: 19 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784785.103416:0:18953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501800, rc 0) 00000100:00100000:3.0:1787784785.103450:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+19:20366:x1874627643183232:12345-0@lo:101:mount.lustre.0 Request processed in 145us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784785.103457:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787784785.103498:0:20366:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318916d180 going to sleep for 11 seconds 00000100:00100000:3.0:1787784785.103520:0:20366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643183232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784785.103535:0:20366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bf501200/0xffb8d925c20bc34a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc351 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784785.103544:0:20366:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bf501200/0xffb8d925c20bc34a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bc351 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787784785.104303:0:20366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:3.0:1787784785.105146:0:20366:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784785.105471:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1787784785.105515:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1787784785.105889:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1787784785.105945:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1787784785.105983:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1787784785.106032:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1787784785.106069:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1787784785.106117:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1787784785.106165:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1787784785.106199:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1787784785.106232:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1787784785.106279:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1787784785.106314:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1787784785.106349:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1787784785.107545:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1787784785.107839:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1787784785.107873:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1787784785.107926:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1787784785.107984:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1787784785.108020:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1787784785.108070:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1787784785.108109:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1787784785.108142:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1787784785.108191:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1787784785.108224:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:3.0:1787784785.108256:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:3.0:1787784785.108304:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:3.0:1787784785.108341:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:3.0:1787784785.108410:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:3.0:1787784785.108460:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:3.0:1787784785.108492:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:3.0:1787784785.108524:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:3.0:1787784785.110772:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:3.0:1787784785.110901:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:3.0:1787784785.110957:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:3.0:1787784785.115892:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:3.0:1787784785.115980:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:3.0:1787784785.116016:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:3.0:1787784785.116065:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:3.0:1787784785.116104:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:3.0:1787784785.116215:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:3.0:1787784785.116222:0:20366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:3.0:1787784785.116320:0:20366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643183360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784785.116410:0:20366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784785.116468:0:20366:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318916d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787784785.116470:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643183360 00000100:00100000:0.0:1787784785.116482:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643183360 00000100:00100000:0.0:1787784785.116538:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787784785.116548:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+19:20366:x1874627643183360:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784785.116786:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+19:20366:x1874627643183360:12345-0@lo:501:mount.lustre.0 Request processed in 240us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784785.116794:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787784785.116851:0:20366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643183360:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784785.116885:0:20366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643183488:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784785.116921:0:20366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784785.117105:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643183488 00000100:00100000:1.0:1787784785.117111:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643183488 00000100:00100000:1.0:1787784785.117581:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787784785.117591:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+19:20366:x1874627643183488:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784785.118032:0:20366:0:(client.c:2715:ptlrpc_set_wait()) set ffff943190875780 going to sleep for 11 seconds 00000100:00100000:1.0:1787784785.118201:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+19:20366:x1874627643183488:12345-0@lo:503:mount.lustre.0 Request processed in 610us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784785.118209:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787784785.122141:0:20366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643183488:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787784785.124771:0:20366:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787784785.125167:0:20366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643183616:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784785.125400:0:20366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784785.125446:0:20366:0:(client.c:2715:ptlrpc_set_wait()) set ffff943190875780 going to sleep for 11 seconds 00000100:00100000:1.0:1787784785.125521:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643183616 00000100:00100000:1.0:1787784785.125528:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643183616 00000100:00100000:1.0:1787784785.125574:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787784785.125584:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+19:20366:x1874627643183616:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784785.125924:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+19:20366:x1874627643183616:12345-0@lo:502:mount.lustre.0 Request processed in 340us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784785.125933:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787784785.126874:0:20366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643183616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787784785.127153:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1787784785.127209:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1787784785.127248:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1787784785.127292:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1787784785.127328:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1787784785.127394:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1787784785.127429:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1787784785.127464:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1787784785.127515:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1787784785.127780:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1787784785.127825:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1787784785.127894:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1787784785.127932:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1787784785.127966:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1787784785.128014:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1787784785.128050:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1787784785.128083:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1787784785.128130:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1787784785.128165:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1787784785.128206:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1787784785.128270:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1787784785.128310:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1787784785.128345:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1787784785.128534:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1787784785.128759:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:3.0:1787784785.128799:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:3.0:1787784785.128840:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:3.0:1787784785.128889:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:3.0:1787784785.128922:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:3.0:1787784785.128973:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:3.0:1787784785.129009:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:3.0:1787784785.129043:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:3.0:1787784785.129076:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:3.0:1787784785.129127:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:3.0:1787784785.129164:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:3.0:1787784785.129212:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:3.0:1787784785.129246:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:3.0:1787784785.129281:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:3.0:1787784785.129331:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:3.0:1787784785.130799:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:3.0:1787784785.130874:0:20366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643183744:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784785.130970:0:20366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784785.131028:0:20366:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318916d840 going to sleep for 11 seconds 00000100:00100000:1.0:1787784785.131100:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643183744 00000100:00100000:1.0:1787784785.131108:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643183744 00000100:00100000:1.0:1787784785.131171:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787784785.131181:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3899450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+19:20366:x1874627643183744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784785.131467:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3899450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+19:20366:x1874627643183744:12345-0@lo:502:mount.lustre.0 Request processed in 287us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784785.131476:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787784785.131596:0:20366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643183744:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787784785.131710:0:20366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:3.0:1787784785.131721:0:20366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787784785.133027:0:20376:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787784785.133051:0:20376:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9431908f8000) 00000020:00000080:3.0:1787784785.133075:0:20376:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1787784785.133156:0:20376:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9431be3c4800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787784785.133160:0:20376:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9431be3c4800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787784785.133163:0:20376:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9431be3c4800 3 00010000:00080000:3.0:1787784785.133196:0:20376:0:(ldlm_lib.c:102:import_set_conn()) imp ffff943081db3800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.159@tcp at head 00010000:00010000:3.0:1787784785.135291:0:20376:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1787784785.135566:0:20376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787784785.135621:0:20376:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787784785.135636:0:20376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xffb8d925c20bc35f 00000100:00080000:3.0:1787784785.135650:0:20376:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787784785.135657:0:20376:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff943081db3800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:3.0:1787784785.135712:0:20376:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431962a6580 x1874627643183872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787784785.135743:0:20376:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787784785.136069:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1874627643183872:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787784785.136148:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784785.136586:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643183872 00000100:00100000:3.0:1787784785.136595:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643183872 00000100:00100000:3.0:1787784785.136788:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787784785.136797:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3292:x1874627643183872:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787784785.136826:0:18960:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 599 last 0 00000020:00000080:3.0:1787784785.136865:0:18960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xffb8d925c20bc366 00000004:00100000:3.0:1787784785.136881:0:18960:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787784785.136914:0:18960:0:(import.c:65:import_set_state_nolock()) ffff9431bf461000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787784785.136983:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1874627643183872:12345-0@lo:38:llog_process_th.0 Request processed in 185us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784785.136990:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787784785.137216:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431962a6580 x1874627643183872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784785.137227:0:3292:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787784785.137287:0:3292:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1787784785.137296:0:3292:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787784785.137300:0:3292:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787784785.137312:0:3292:0:(import.c:65:import_set_state_nolock()) ffff943081db3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787784785.137318:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1874627643183872:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787784785.137782:0:20376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:1.0:1787784785.139447:0:20366:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787784785.139487:0:20366:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787784785.139517:0:20366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf501200/0xffb8d925c20bc34a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc351 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784785.139528:0:20366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bf501200/0xffb8d925c20bc34a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc351 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787784785.139597:0:20366:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787784785.139599:0:20366:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787784785.139600:0:20366:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784785.139601:0:20366:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784785.139602:0:20366:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784785.139604:0:20366:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784785.139612:0:20366:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787784785.139613:0:20366:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784785.139614:0:20366:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787784785.139618:0:20366:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787784785.139620:0:20366:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787784785.139622:0:20366:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787784785.139623:0:20366:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784785.139624:0:20366:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784785.139624:0:20366:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784785.139625:0:20366:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784785.139626:0:20366:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787784785.139628:0:20366:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784785.139629:0:20366:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787784785.139662:0:20366:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787784785.139684:0:20366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643184000:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787784785.139760:0:20366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784785.139803:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643184000 00000100:00100000:1.0:1787784785.139810:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643184000 00000100:00100000:1.0:1787784785.139854:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787784785.139865:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3899050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+19:20366:x1874627643184000:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787784785.139894:0:18953:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787784785.139911:0:18953:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787784785.140411:0:20366:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186264900 going to sleep for 11 seconds 20000000:01000000:3.0:1787784785.180829:0:18953:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787784785.180844:0:18953:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787784785.180865:0:18975:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787784785.180870:0:18975:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787784785.180893:0:18975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9431bf501a00/0xffb8d925c20bc36d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784785.180911:0:18975:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943181512600/0xffb8d925c20bc22b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc224 expref: 19 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784785.180941:0:18975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9431bf501a00/0xffb8d925c20bc36d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784785.180984:0:18975:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943181512600/0xffb8d925c20bc22b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20bc224 expref: 19 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784785.181000:0:18975:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff943181512600/0xffb8d925c20bc22b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20bc224 expref: 19 pid: 18953 timeout: 700 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784785.181015:0:18975:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a6d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18975:1874627643184128:0@lo:104: 00000100:00100000:3.0:1787784785.181085:0:18975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784785.181131:0:18975:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318916de40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784785.181151:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643184128 00000100:00100000:3.0:1787784785.181159:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643184128 00000100:00100000:3.0:1787784785.181213:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787784785.181222:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17693f43-cfcf-4d1e-8495-73723b171a31+3:18975:x1874627643184128:12345-0@lo:104: 00010000:00010000:3.0:1787784785.181513:0:18943:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff9431bf501400/0xffb8d925c20bc224 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bc22b expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784785.181617:0:18943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787784785.181624:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17693f43-cfcf-4d1e-8495-73723b171a31+3:18975:x1874627643184128:12345-0@lo:104: Request processed in 403us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784785.181632:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787784785.182125:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784785.182134:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431bf501400/0xffb8d925c20bc224 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bc22b expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784785.182146:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501400 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:2.0:1787784785.182151:0:18947:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431bf501400/0xffb8d925c20bc224 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20bc22b expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784785.182161:0:18947:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431bf501400/0xffb8d925c20bc224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20bc22b expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784785.182171:0:18947:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431bf501400/0xffb8d925c20bc224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20bc22b expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784785.182178:0:18947:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784785.182213:0:18947:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431bf501400/0xffb8d925c20bc224 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bc22b expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784785.182224:0:18947:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784785.182256:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431bf501400/0xffb8d925c20bc224 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bc22b expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784785.182264:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431bf501400/0xffb8d925c20bc224 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bc22b expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784785.182284:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784785.182286:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784785.182287:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784785.182316:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319206f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17693f43-cfcf-4d1e-8495-73723b171a31:3295:1874627643184256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784785.182395:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784785.182452:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643184256 00000100:00100000:2.0:1787784785.182460:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643184256 00010000:00010000:2.0:1787784785.182486:0:18945:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943181512600/0xffb8d925c20bc22b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bc224 expref: 20 pid: 18953 timeout: 700 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784785.182509:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784785.182521:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17693f43-cfcf-4d1e-8495-73723b171a31+20:3295:x1874627643184256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784785.182532:0:18945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784785.182538:0:18945:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943181512600/0xffb8d925c20bc22b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bc224 expref: 20 pid: 18953 timeout: 700 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784785.182552:0:18945:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943181512600/0xffb8d925c20bc22b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20bc224 expref: 20 pid: 18953 timeout: 700 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784785.182568:0:18945:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9431bf501a00/0xffb8d925c20bc36d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784785.182578:0:18945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf501a00/0xffb8d925c20bc36d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787784785.182596:0:18945:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001726624s 00010000:00010000:2.0:1787784785.182601:0:18945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9431bf501a00/0xffb8d925c20bc36d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784785.182608:0:18945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9431bf501a00/0xffb8d925c20bc36d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784785.182615:0:18945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9431bf501a00/0xffb8d925c20bc36d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784785.182632:0:18945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9431bf501a00/0xffb8d925c20bc36d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784785.182638:0:18945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501a00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784785.182642:0:18945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9431bf501a00/0xffb8d925c20bc36d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784785.182649:0:18945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9431bf501a00/0xffb8d925c20bc36d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784785.182658:0:18945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9431bf501a00/0xffb8d925c20bc36d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784785.182668:0:18945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784785.182708:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17693f43-cfcf-4d1e-8495-73723b171a31+20:3295:x1874627643184256:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784785.182718:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784785.182755:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319206f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17693f43-cfcf-4d1e-8495-73723b171a31:3295:1874627643184256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784785.186912:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3899050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+19:20366:x1874627643184000:12345-0@lo:253:mount.lustre.0 Request processed in 47041us (47145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784785.186931:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787784785.187072:0:20366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189163840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17693f43-cfcf-4d1e-8495-73723b171a31:20366:1874627643184000:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787784785.187088:0:20366:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787784785.187091:0:20366:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787784785.187093:0:20366:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787784785.187094:0:20366:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784785.187095:0:20366:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784785.187096:0:20366:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784785.187097:0:20366:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784785.187098:0:20366:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784785.187100:0:20366:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784785.187101:0:20366:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787784785.187113:0:20366:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787784785.187506:0:20366:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787784785.187644:0:20366:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00010000:00010000:1.0:1787784785.187780:0:18975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943181512600/0xffb8d925c20bc22b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20bc224 expref: 18 pid: 18953 timeout: 700 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784785.187796:0:18975:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a6d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18975:1874627643184128:0@lo:104: 00080000:10000000:2.0:1787784785.187817:0:20366:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00010000:00010000:1.0:1787784785.187817:0:18975:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9431bf501a00/0xffb8d925c20bc36d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784785.187827:0:18975:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9431bf501a00/0xffb8d925c20bc36d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784785.187834:0:18975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9431bf501a00/0xffb8d925c20bc36d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784785.187840:0:18975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf501a00/0xffb8d925c20bc36d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1787784785.187973:0:20366:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787784785.188136:0:20366:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787784785.188572:0:20366:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787784785.191022:0:20366:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1787784785.249616:0:20366:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787784785.249627:0:20366:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787784785.249663:0:20366:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787784785.249731:0:20366:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.159@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787784785.249746:0:20366:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787784785.249784:0:20366:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787784785.402827:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784786.420605:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787784786.612492:0:18956:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787784786.612500:0:18956:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9430827c4800 from 11 10000000:01000000:3.0:1787784786.612506:0:18956:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787784786.612555:0:18956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf500c00/0xffb8d925c20bc374 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784786.612568:0:18956:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bf500c00/0xffb8d925c20bc374 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784786.612580:0:18956:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bf500c00/0xffb8d925c20bc374 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784786.612609:0:18956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643184384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784786.612691:0:18956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784786.612784:0:18956:0:(client.c:2715:ptlrpc_set_wait()) set ffff943190854000 going to sleep for 11 seconds 00000100:00100000:1.0:1787784786.616058:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643184384 00000100:00100000:1.0:1787784786.616074:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643184384 00000100:00100000:1.0:1787784786.616186:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787784786.616199:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3898050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+18:18956:x1874627643184384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784786.616219:0:18954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784786.616249:0:18954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431829d0600/0xffb8d925c20bc37b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bc374 expref: -99 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784786.616280:0:18954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431829d0600/0xffb8d925c20bc37b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bc374 expref: 19 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784786.616299:0:18954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431829d0600/0xffb8d925c20bc37b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc374 expref: 19 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784786.616308:0:18954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d0600, rc 0) 00000100:00100000:1.0:1787784786.617345:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3898050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+19:18956:x1874627643184384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1144us (4649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784786.617356:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787784786.617477:0:18956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643184384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784786.617498:0:18956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bf500c00/0xffb8d925c20bc374 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc37b expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784786.617509:0:18956:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bf500c00/0xffb8d925c20bc374 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bc37b expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784786.617579:0:18956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319206e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643184512:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787784786.617626:0:18956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784786.617993:0:18956:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bee8d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784786.618110:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643184512 00000100:00100000:0.0:1787784786.618117:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643184512 00000100:00100000:0.0:1787784786.618150:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787784786.618157:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+19:18956:x1874627643184512:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787784786.618175:0:18952:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787784786.618193:0:18952:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787784786.618196:0:18952:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1787784786.618301:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+19:18956:x1874627643184512:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 144us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784786.618309:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787784786.618442:0:18956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319206e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643184512:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787784786.618500:0:18956:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787784786.618508:0:18956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf500c00/0xffb8d925c20bc374 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc37b expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784786.618516:0:18956:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bf500c00/0xffb8d925c20bc374 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc37b expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787784786.998007:0:18992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787784787.447523:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784788.471790:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784789.301248:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643184640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784789.301356:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784789.301600:0:19647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643184640 00000100:00100000:3.0:1787784789.301608:0:19647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643184640 00000100:00100000:3.0:1787784789.301685:0:19647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787784789.301695:0:19647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643184640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784789.301735:0:19647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1787784789.301796:0:19647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643184640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784789.301804:0:19647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784789.301898:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643184640:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787784789.301960:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787784789.502596:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787784790.328750:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787784790.328757:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787784790.328761:0:475:0:(import.c:65:import_set_state_nolock()) ffff9431b5c4d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787784790.328770:0:475:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 599 00000100:00080000:3.0:1787784790.328774:0:475:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787784790.328801:0:475:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9431b5c4d800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:3.0:1787784790.328825:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431962a5680 x1874627643185024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787784790.328914:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17693f43-cfcf-4d1e-8495-73723b171a31:3293:1874627643184768:0@lo:400:kworker.0 00000100:00100000:3.0:1787784790.328995:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784790.329041:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643185408:0@lo:400:kworker.0 00000100:00100000:3.0:1787784790.329067:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784790.329091:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784790.329097:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643184896:0@lo:400:kworker.0 00000100:00100000:3.0:1787784790.329119:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784790.329146:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643185024:0@lo:8:kworker.0 00000100:00100000:3.0:1787784790.329166:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784790.329266:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643185152:0@lo:400:kworker.0 00000100:00100000:3.0:1787784790.329295:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784790.329314:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787784790.329320:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643185280:0@lo:400:kworker.0 00000100:00100000:3.0:1787784790.329341:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784790.329386:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643184768 00000100:00100000:3.0:1787784790.329394:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643184768 00000100:00100000:3.0:1787784790.329435:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787784790.329446:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3898450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+19:3293:x1874627643184768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784790.329498:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3898450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+19:3293:x1874627643184768:12345-0@lo:400:kworker.0 Request processed in 54us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784790.329506:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787784790.329537:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643185408 00000100:00100000:3.0:1787784790.329547:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643185408 00000100:00100000:3.0:1787784790.329583:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643185152 00000100:00100000:3.0:1787784790.329586:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643185152 00000100:00100000:3.0:1787784790.329595:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643185280 00000100:00100000:3.0:1787784790.329597:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643185280 00000100:00100000:3.0:1787784790.329611:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787784790.329616:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643185408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784790.329660:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643185408:12345-0@lo:400:kworker.0 Request processed in 44us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784790.329667:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787784790.329680:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787784790.329686:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643185152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784790.329717:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643185152:12345-0@lo:400:kworker.0 Request processed in 32us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784790.329723:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787784790.329734:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787784790.329741:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643185280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784790.329766:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643185280:12345-0@lo:400:kworker.0 Request processed in 26us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784790.329772:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787784790.329795:0:20123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643184896 00000100:00100000:3.0:1787784790.329798:0:20123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643184896 00000100:00100000:3.0:1787784790.329826:0:20123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643185024 00000100:00100000:3.0:1787784790.329829:0:20123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643185024 00000100:00100000:3.0:1787784790.329845:0:20123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787784790.329851:0:20123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643184896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784790.329881:0:20123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643184896:12345-0@lo:400:kworker.0 Request processed in 30us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784790.329895:0:20123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787784790.329907:0:20123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787784790.329911:0:20123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3292:x1874627643185024:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787784790.329935:0:20123:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 605 last 0 00000020:00000080:3.0:1787784790.329963:0:20123:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xffb8d925c20bc382 00002000:00100000:3.0:1787784790.329977:0:20123:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff943081db6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113936 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787784790.329981:0:20123:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787784790.329984:0:20123:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1787784790.330353:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643184896:0@lo:400:kworker.0 00000100:00100000:1.0:1787784790.330383:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17693f43-cfcf-4d1e-8495-73723b171a31:3293:1874627643184768:0@lo:400:kworker.0 00010000:00080000:1.0:1787784790.330400:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431962a7480 x1874627643185408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784790.330409:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643185408:0@lo:400:kworker.0 00000100:00080000:1.0:1787784790.330880:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787784790.330906:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431962a61c0 x1874627643185280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784790.330917:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643185280:0@lo:400:kworker.0 00010000:00080000:1.0:1787784790.330928:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431962a5e00 x1874627643185152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784790.330936:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643185152:0@lo:400:kworker.0 00002000:00080000:3.0:1787784790.331956:0:20123:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787784790.331991:0:20123:0:(import.c:65:import_set_state_nolock()) ffff943081db1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787784790.332070:0:20123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3292:x1874627643185024:12345-0@lo:8:kworker.0 Request processed in 2155us (2901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784790.332079:0:20123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787784790.332128:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431962a5680 x1874627643185024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787784815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784790.332140:0:3292:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787784790.332148:0:3292:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787784790.332156:0:3292:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787784790.332162:0:3292:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787784790.332164:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431b5c4d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787784790.332177:0:3292:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787784790.332182:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643185024:0@lo:8:kworker.0 00000004:00080000:1.0:1787784790.332271:0:18983:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787784790.332731:0:18983:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 605159365061ns, next at 0ns, rc = 0 00000004:00080000:3.0:1787784790.333470:0:18984:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1787784790.333499:0:18984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197014780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18984:1874627643185664:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787784790.333571:0:18984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784790.333597:0:18984:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186131180 going to sleep for 11 seconds 00000100:00100000:1.0:1787784790.334013:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643185536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784790.334343:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784790.336973:0:19647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643185536 00000100:00100000:3.0:1787784790.336988:0:19647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643185536 00000100:00100000:3.0:1787784790.337058:0:19647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787784790.337068:0:19647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189160b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1874627643185536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784790.337102:0:19647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784790.337193:0:19647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189160b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1874627643185536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (2850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784790.337201:0:19647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787784790.337519:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787784790.337539:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643185664 00000100:00100000:3.0:1787784790.337544:0:19646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643185664 00000100:00100000:3.0:1787784790.337574:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787784790.337581:0:19646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197017840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18984:x1874627643185664:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:3.0:1787784790.342957:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b45b61c0 x1874627643185536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784790.342994:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643185536:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1787784790.343768:0:19646:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787784790.343779:0:19646:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:3.0:1787784790.343784:0:19646:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:65) 00002000:00010000:3.0:1787784790.367977:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.367990:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bc389 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.368010:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.368016:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.368033:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bc389 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.368055:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bc389 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.368066:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bc389 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.368074:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bc389 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.368103:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784790.368116:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784790.368123:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bc389 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.368131:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784790.368136:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bc389 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.368146:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bc389 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.368164:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bc389 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.368184:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bc389 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.372966:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.372970:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.372972:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784790.373681:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.373693:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc390 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.373712:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.373718:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.373725:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc390 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.373742:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc390 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.373753:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc390 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.373763:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc390 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.373787:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784790.374200:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.374213:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc397 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.374223:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.374226:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.374231:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc397 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.374242:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc397 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.374250:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc397 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.374256:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc397 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.374271:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787784790.374285:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787784790.374291:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc390 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.374298:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501c00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784790.374303:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc390 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.374312:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc390 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.374338:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc390 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.374346:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc390 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.374390:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784790.374394:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc397 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.374401:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500e00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784790.374405:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc397 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.374413:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc397 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.374423:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc397 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.374430:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc397 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.374443:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.374444:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.374453:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784790.374890:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.374896:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc39e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.374906:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.374910:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.374915:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc39e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.374924:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc39e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.374933:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc39e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.374940:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc39e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.374958:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784790.374969:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784790.374973:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc39e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.374979:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501000 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784790.374983:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc39e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.375003:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc39e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.375015:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc39e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.375022:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc39e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.375037:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.375038:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.375040:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784790.375481:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.375488:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc3a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.375496:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.375500:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.375504:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc3a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.375514:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc3a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.375523:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc3a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.375538:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc3a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.375552:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784790.375562:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784790.375566:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc3a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.375574:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784790.375577:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc3a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.375585:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc3a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.375597:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc3a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.375604:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc3a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.375617:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.375619:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.375621:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784790.376235:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784790.385256:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.385279:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bc3ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.385297:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.385302:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.385310:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bc3ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.385328:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bc3ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.385339:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bc3ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.385347:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bc3ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.385397:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784790.385413:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784790.385418:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bc3ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.385427:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784790.385432:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bc3ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.385440:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bc3ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.385465:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bc3ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.385474:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bc3ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.385492:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.385495:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.385497:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784790.385936:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.385943:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c92af9b8/0xffb8d925c20bc3b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.385952:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.385955:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.385961:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c92af9b8/0xffb8d925c20bc3b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.385971:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c92af9b8/0xffb8d925c20bc3b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.385979:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c92af9b8/0xffb8d925c20bc3b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.385987:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c92af9b8/0xffb8d925c20bc3b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.386017:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784790.386489:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.386496:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de6ed564/0xffb8d925c20bc3ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.386506:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.386509:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.386514:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de6ed564/0xffb8d925c20bc3ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.386524:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de6ed564/0xffb8d925c20bc3ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.386533:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de6ed564/0xffb8d925c20bc3ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.386541:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de6ed564/0xffb8d925c20bc3ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.386557:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787784790.386566:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787784790.386572:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c92af9b8/0xffb8d925c20bc3b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.386580:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500800 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784790.386590:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c92af9b8/0xffb8d925c20bc3b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.386600:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c92af9b8/0xffb8d925c20bc3b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.386614:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c92af9b8/0xffb8d925c20bc3b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.386622:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c92af9b8/0xffb8d925c20bc3b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.386638:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784790.387281:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.390930:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de6ed564/0xffb8d925c20bc3ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.390950:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784790.390956:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de6ed564/0xffb8d925c20bc3ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.390969:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de6ed564/0xffb8d925c20bc3ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.390994:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de6ed564/0xffb8d925c20bc3ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.391002:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de6ed564/0xffb8d925c20bc3ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.391064:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.391067:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.391069:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784790.396152:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.396166:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070a1355e/0xffb8d925c20bc3c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.396252:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.396258:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.396266:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070a1355e/0xffb8d925c20bc3c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.396284:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070a1355e/0xffb8d925c20bc3c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.396296:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070a1355e/0xffb8d925c20bc3c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.396305:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070a1355e/0xffb8d925c20bc3c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.396342:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784790.396760:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.396767:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060b83d8c/0xffb8d925c20bc3c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.396788:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.396791:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.396795:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060b83d8c/0xffb8d925c20bc3c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.396804:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060b83d8c/0xffb8d925c20bc3c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.396812:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060b83d8c/0xffb8d925c20bc3c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.396819:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060b83d8c/0xffb8d925c20bc3c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.396835:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787784790.396852:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787784790.396858:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070a1355e/0xffb8d925c20bc3c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.396865:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501e00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784790.396870:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070a1355e/0xffb8d925c20bc3c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.396879:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070a1355e/0xffb8d925c20bc3c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.396912:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070a1355e/0xffb8d925c20bc3c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.396921:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070a1355e/0xffb8d925c20bc3c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.396941:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784790.396944:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060b83d8c/0xffb8d925c20bc3c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.396952:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501a00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784790.396955:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060b83d8c/0xffb8d925c20bc3c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.396963:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060b83d8c/0xffb8d925c20bc3c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.396973:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060b83d8c/0xffb8d925c20bc3c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.396981:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060b83d8c/0xffb8d925c20bc3c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.396992:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.396994:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.397000:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787784790.398880:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1787784790.399495:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784790.400735:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.400748:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc3cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.400765:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.400770:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.400777:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc3cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.400791:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc3cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.400802:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc3cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.400810:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc3cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.401389:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784790.406947:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.406963:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc3d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.406982:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.406986:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.406993:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc3d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.407020:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc3d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.407030:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc3d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.407038:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc3d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.407181:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784790.407189:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc3cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.407257:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784790.407262:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc3cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.407271:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc3cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.407293:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc3cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.407301:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc3cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.407322:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784790.407325:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc3d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.407332:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501000 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784790.407336:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc3d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.407344:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc3d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.407361:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc3d6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.407384:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784790.407385:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784790.407387:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787784790.407456:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787784790.407650:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787784790.407656:0:19646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc3d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787784790.408229:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.408236:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc3dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.408249:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.408253:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.408258:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc3dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.408268:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc3dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.408290:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc3dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.408298:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc3dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.408317:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784790.408329:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784790.408334:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc3dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.408341:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500e00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784790.408345:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc3dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.408353:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc3dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.408400:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc3dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.408409:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc3dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.408423:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.408431:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.408433:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784790.408867:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.408874:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc3e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.408883:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.408887:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.408891:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc3e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.408901:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc3e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.408909:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc3e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.408917:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc3e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.408932:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784790.408941:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784790.408945:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc3e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.408951:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501c00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784790.408954:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc3e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.408974:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc3e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.408986:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc3e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.408994:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc3e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.409009:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.409011:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.409012:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784790.409453:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.409460:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b60f191/0xffb8d925c20bc3eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.409469:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.409472:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.409476:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b60f191/0xffb8d925c20bc3eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.409485:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b60f191/0xffb8d925c20bc3eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.409492:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b60f191/0xffb8d925c20bc3eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.409506:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b60f191/0xffb8d925c20bc3eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.409521:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784790.409531:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784790.409536:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b60f191/0xffb8d925c20bc3eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.409543:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784790.409547:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b60f191/0xffb8d925c20bc3eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.409555:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b60f191/0xffb8d925c20bc3eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.409568:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b60f191/0xffb8d925c20bc3eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.409576:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b60f191/0xffb8d925c20bc3eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.409591:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.409593:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.409594:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784790.410013:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.410027:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e251c597/0xffb8d925c20bc3f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.410036:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.410040:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.410044:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e251c597/0xffb8d925c20bc3f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.410054:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e251c597/0xffb8d925c20bc3f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.410063:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e251c597/0xffb8d925c20bc3f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.410070:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e251c597/0xffb8d925c20bc3f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.410084:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784790.410092:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784790.410095:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e251c597/0xffb8d925c20bc3f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.410102:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1a00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784790.410106:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e251c597/0xffb8d925c20bc3f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.410113:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e251c597/0xffb8d925c20bc3f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.410131:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e251c597/0xffb8d925c20bc3f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.410139:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e251c597/0xffb8d925c20bc3f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.410153:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.410155:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.410156:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784790.410575:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.410582:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c76e7ec/0xffb8d925c20bc3f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.410591:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.410595:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.410599:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c76e7ec/0xffb8d925c20bc3f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.410609:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c76e7ec/0xffb8d925c20bc3f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.410618:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c76e7ec/0xffb8d925c20bc3f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.410626:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c76e7ec/0xffb8d925c20bc3f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.410923:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.412897:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784790.413623:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.413632:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030ccf08b/0xffb8d925c20bc400 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.413661:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.413666:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.413672:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030ccf08b/0xffb8d925c20bc400 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.413685:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030ccf08b/0xffb8d925c20bc400 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.413696:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030ccf08b/0xffb8d925c20bc400 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.413703:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030ccf08b/0xffb8d925c20bc400 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.413722:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787784790.413734:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787784790.413740:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c76e7ec/0xffb8d925c20bc3f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.413748:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0e00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784790.413759:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c76e7ec/0xffb8d925c20bc3f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.413769:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c76e7ec/0xffb8d925c20bc3f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.413786:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c76e7ec/0xffb8d925c20bc3f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.413793:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c76e7ec/0xffb8d925c20bc3f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.413810:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784790.413814:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030ccf08b/0xffb8d925c20bc400 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.413820:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1800 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784790.413823:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030ccf08b/0xffb8d925c20bc400 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.413831:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030ccf08b/0xffb8d925c20bc400 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.413841:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030ccf08b/0xffb8d925c20bc400 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.413848:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030ccf08b/0xffb8d925c20bc400 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.413868:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.413869:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.413871:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784790.414338:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784790.414514:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.414521:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc407 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.414532:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.414536:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.414541:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc407 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.414552:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc407 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.414560:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc407 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.414568:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc407 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.414586:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784790.415009:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.415015:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f86c9a9/0xffb8d925c20bc40e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.415036:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.415040:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.415044:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f86c9a9/0xffb8d925c20bc40e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.415054:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f86c9a9/0xffb8d925c20bc40e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.415062:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f86c9a9/0xffb8d925c20bc40e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.415070:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f86c9a9/0xffb8d925c20bc40e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.415082:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787784790.415289:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784790.415296:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc407 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.415303:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1e00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784790.415307:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc407 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.415315:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc407 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.415328:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc407 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.415336:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2dcc81d/0xffb8d925c20bc407 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.415352:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784790.415378:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f86c9a9/0xffb8d925c20bc40e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.415385:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784790.415389:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f86c9a9/0xffb8d925c20bc40e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.415397:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f86c9a9/0xffb8d925c20bc40e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.415408:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f86c9a9/0xffb8d925c20bc40e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.415415:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f86c9a9/0xffb8d925c20bc40e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.415428:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784790.415429:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784790.415431:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784790.415438:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784790.415818:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.415825:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7f51c08/0xffb8d925c20bc415 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.415835:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.415839:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.415843:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7f51c08/0xffb8d925c20bc415 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.415853:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7f51c08/0xffb8d925c20bc415 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.415872:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7f51c08/0xffb8d925c20bc415 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.415880:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7f51c08/0xffb8d925c20bc415 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.415954:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784790.416668:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.416675:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1682694/0xffb8d925c20bc41c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.416687:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.416690:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.416695:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1682694/0xffb8d925c20bc41c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.416705:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1682694/0xffb8d925c20bc41c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.416713:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1682694/0xffb8d925c20bc41c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.416721:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1682694/0xffb8d925c20bc41c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.416805:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784790.416813:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7f51c08/0xffb8d925c20bc415 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.416820:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0a00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784790.416824:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7f51c08/0xffb8d925c20bc415 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.416844:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7f51c08/0xffb8d925c20bc415 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.416858:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7f51c08/0xffb8d925c20bc415 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.416865:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7f51c08/0xffb8d925c20bc415 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.416882:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784790.416885:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1682694/0xffb8d925c20bc41c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.416891:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0000 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784790.416894:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1682694/0xffb8d925c20bc41c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.416901:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1682694/0xffb8d925c20bc41c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.416909:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1682694/0xffb8d925c20bc41c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.416916:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784790.416917:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784790.416925:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.417115:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787784790.417122:0:19646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1682694/0xffb8d925c20bc41c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.417264:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784790.421124:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.421139:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce7c663c/0xffb8d925c20bc423 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.421157:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.421161:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.421167:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7c663c/0xffb8d925c20bc423 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.421182:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce7c663c/0xffb8d925c20bc423 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.421252:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce7c663c/0xffb8d925c20bc423 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.421261:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7c663c/0xffb8d925c20bc423 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.421285:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784790.421299:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784790.421306:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce7c663c/0xffb8d925c20bc423 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.421320:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0200 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784790.421325:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce7c663c/0xffb8d925c20bc423 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.421335:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce7c663c/0xffb8d925c20bc423 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.421356:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce7c663c/0xffb8d925c20bc423 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.421384:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce7c663c/0xffb8d925c20bc423 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.421408:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.421410:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.421412:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784790.421906:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.421913:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c36bba5/0xffb8d925c20bc42a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.421922:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.421925:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.421929:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c36bba5/0xffb8d925c20bc42a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.421939:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c36bba5/0xffb8d925c20bc42a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.421952:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c36bba5/0xffb8d925c20bc42a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.421958:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c36bba5/0xffb8d925c20bc42a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.421975:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784790.422450:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784790.422457:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c36bba5/0xffb8d925c20bc42a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.422465:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1c00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784790.422469:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c36bba5/0xffb8d925c20bc42a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.422477:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c36bba5/0xffb8d925c20bc42a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.422491:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c36bba5/0xffb8d925c20bc42a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.422499:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c36bba5/0xffb8d925c20bc42a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784790.422516:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784790.422518:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784790.422519:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784790.425661:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.425676:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a73fb56/0xffb8d925c20bc431 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.425694:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.425699:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.425707:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a73fb56/0xffb8d925c20bc431 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.425720:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a73fb56/0xffb8d925c20bc431 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.425730:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a73fb56/0xffb8d925c20bc431 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.425739:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a73fb56/0xffb8d925c20bc431 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.425774:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784790.425790:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784790.425795:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a73fb56/0xffb8d925c20bc431 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.425803:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784790.425808:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a73fb56/0xffb8d925c20bc431 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.425818:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a73fb56/0xffb8d925c20bc431 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.425836:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a73fb56/0xffb8d925c20bc431 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.425844:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a73fb56/0xffb8d925c20bc431 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.425864:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.425866:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.425868:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784790.434667:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.434684:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e251c597/0xffb8d925c20bc438 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.434703:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.434713:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.434720:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e251c597/0xffb8d925c20bc438 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.434735:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e251c597/0xffb8d925c20bc438 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.434746:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e251c597/0xffb8d925c20bc438 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.434754:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e251c597/0xffb8d925c20bc438 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.434781:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787784790.435333:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784790.435341:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e251c597/0xffb8d925c20bc438 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.435351:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1a00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784790.435355:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e251c597/0xffb8d925c20bc438 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.435378:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e251c597/0xffb8d925c20bc438 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.435402:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e251c597/0xffb8d925c20bc438 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.435410:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e251c597/0xffb8d925c20bc438 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.435430:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784790.435432:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784790.435434:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784790.435577:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.435583:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f52a95a/0xffb8d925c20bc43f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.435592:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.435595:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.435600:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f52a95a/0xffb8d925c20bc43f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.435610:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f52a95a/0xffb8d925c20bc43f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.435619:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f52a95a/0xffb8d925c20bc43f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.435632:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f52a95a/0xffb8d925c20bc43f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.435971:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784790.436484:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.436490:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b60f191/0xffb8d925c20bc446 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.436502:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.436505:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.436510:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b60f191/0xffb8d925c20bc446 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.436521:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b60f191/0xffb8d925c20bc446 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.436529:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b60f191/0xffb8d925c20bc446 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.436536:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b60f191/0xffb8d925c20bc446 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.441072:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787784790.441099:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f52a95a/0xffb8d925c20bc43f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.441113:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784790.441119:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f52a95a/0xffb8d925c20bc43f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.441131:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f52a95a/0xffb8d925c20bc43f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.441153:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f52a95a/0xffb8d925c20bc43f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.441162:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f52a95a/0xffb8d925c20bc43f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.443418:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784790.444344:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.444354:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc44d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.444407:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.444412:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.444419:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc44d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.444434:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc44d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.444444:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc44d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.444453:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc44d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.444464:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787784790.444882:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.444889:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc454 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.444898:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.444901:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.444905:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc454 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.444914:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc454 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.444934:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc454 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.444942:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc454 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.444950:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787784790.445304:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787784790.445509:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787784790.445516:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc44d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.445524:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501c00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784790.445529:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc44d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.445539:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc44d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.445571:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc44d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.445579:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094d4ea1b/0xffb8d925c20bc44d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.445596:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784790.445600:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc454 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.445606:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500e00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784790.445609:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc454 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.445617:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc454 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.445626:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc454 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.445633:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bfc6b8e/0xffb8d925c20bc454 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.445654:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784790.445656:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784790.445663:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784790.447655:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784790.447669:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc45b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.447686:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.447691:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.447698:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc45b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.447711:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc45b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.447721:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc45b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.447730:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc45b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.447759:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784790.448186:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787784790.448346:0:20630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784790.448354:0:20630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc45b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.448379:0:20630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784790.448384:0:20630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc45b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.448394:0:20630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc45b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.448411:0:20630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc45b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.448419:0:20630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c8bb52e/0xffb8d925c20bc45b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.448442:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b60f191/0xffb8d925c20bc446 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.448449:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784790.448452:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b60f191/0xffb8d925c20bc446 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.448460:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b60f191/0xffb8d925c20bc446 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.448485:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b60f191/0xffb8d925c20bc446 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.448492:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b60f191/0xffb8d925c20bc446 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784790.448507:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784790.448509:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784790.448511:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784790.448517:0:20630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784790.448519:0:20630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784790.448520:0:20630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784790.448602:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784790.450696:0:19646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc462 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.450718:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=605s v=(0 0) 00010000:00010000:3.0:1787784790.450723:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784790.450730:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc462 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.450756:0:19646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc462 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.450770:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc462 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.450780:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc462 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784790.450806:0:19646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787784790.451389:0:18947:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784790.451399:0:18947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc462 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784790.451410:0:18947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501000 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784790.451414:0:18947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc462 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784790.451424:0:18947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc462 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784790.451444:0:18947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc462 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784790.451452:0:18947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e783b743/0xffb8d925c20bc462 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784790.451474:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784790.451476:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784790.451477:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787784790.453918:0:19646:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:3.0:1787784790.454032:0:19646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197017840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:18984:x1874627643185664:12345-0@lo:5:osp-pre-1-0.0 Request processed in 116447us (120456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784790.454043:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787784790.454186:0:18984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197014780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18984:1874627643185664:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787784790.454212:0:18984:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787784790.454262:0:18984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431891603c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18984:1874627643185792:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787784790.454309:0:18984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784790.454353:0:18984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431862646c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784790.454393:0:19645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643185792 00000100:00100000:1.0:1787784790.454400:0:19645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643185792 00000100:00100000:1.0:1787784790.454440:0:19645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787784790.454448:0:19645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:18984:x1874627643185792:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787784790.454492:0:19645:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:1.0:1787784790.457153:0:19645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:18984:x1874627643185792:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2698us (2837us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1787784790.457165:0:19645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787784790.457287:0:18984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431891603c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18984:1874627643185792:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787784790.457303:0:18984:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00010000:00010000:0.0:1787784790.516577:0:20630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784791.540700:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787784792.536801:0:20725:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787784792.565507:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784793.588947:0:20630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784794.424415:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197015a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643185920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784794.424503:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784794.424975:0:19647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643185920 00000100:00100000:3.0:1787784794.424996:0:19647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643185920 00000100:00100000:3.0:1787784794.425105:0:19647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787784794.425117:0:19647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643185920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784794.425158:0:19647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1787784794.425214:0:19647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643185920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784794.425222:0:19647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787784794.425275:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197015a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643185920:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787784794.426047:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787784794.621965:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784794.862684:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784794.862781:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634795392 00000100:00100000:3.0:1787784794.862792:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634795392 00000100:00100000:3.0:1787784794.862842:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 76 00000100:00100000:3.0:1787784794.862851:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3899850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2361:x1874627634795392:12345-192.168.202.59@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787784794.862894:0:18953:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b3c44031-71ab-414a-bb9a-73f59e219c51@192.168.202.59@tcp t0 exp 0000000000000000 cur 609 last 0 00000020:00000080:3.0:1787784794.862927:0:18953:0:(genops.c:1385:class_connect()) connect: client b3c44031-71ab-414a-bb9a-73f59e219c51, cookie 0xffb8d925c20bc469 00000100:00080000:3.0:1787784794.863088:0:18953:0:(import.c:65:import_set_state_nolock()) ffff943081db0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787784794.863170:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3899850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3c44031-71ab-414a-bb9a-73f59e219c51+5:2361:x1874627634795392:12345-192.168.202.59@tcp:250:mount.lustre.0 Request processed in 318us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784794.863178:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 76 00000100:00100000:3.0:1787784794.877920:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784794.881352:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634795520 00000100:00100000:1.0:1787784794.881392:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634795520 00000100:00100000:1.0:1787784794.881466:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 77 00000100:00100000:1.0:1787784794.881476:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+5:16776:x1874627634795520:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787784794.881493:0:18954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784794.881512:0:18954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431829d0400/0xffb8d925c20bc470 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849aec2 expref: -99 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784794.881544:0:18954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431829d0400/0xffb8d925c20bc470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aec2 expref: 6 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784794.881577:0:18954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431829d0400/0xffb8d925c20bc470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aec2 expref: 6 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784794.881586:0:18954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d0400, rc 0) 00000100:00100000:1.0:1787784794.881724:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+6:16776:x1874627634795520:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 249us (3816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784794.881731:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 77 00000100:00100000:2.0:1787784794.889108:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784794.889733:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634795648 00000100:00100000:0.0:1787784794.889747:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634795648 00000100:00100000:0.0:1787784794.889817:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 78 00000100:00100000:0.0:1787784794.889828:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+6:16776:x1874627634795648:12345-192.168.202.59@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787784794.891735:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+6:16776:x1874627634795648:12345-192.168.202.59@tcp:501:mount.lustre.0 Request processed in 1900us (2627us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787784794.891749:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 78 00000100:00100000:2.0:1787784794.895039:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784794.895298:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634795776 00000100:00100000:3.0:1787784794.895309:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634795776 00000100:00100000:3.0:1787784794.895390:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 79 00000100:00100000:3.0:1787784794.895401:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3c44031-71ab-414a-bb9a-73f59e219c51+6:16776:x1874627634795776:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787784794.895417:0:18953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784794.895436:0:18953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf501e00/0xffb8d925c20bc477 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849aec9 expref: -99 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784794.895484:0:18953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf501e00/0xffb8d925c20bc477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aec9 expref: 7 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784794.895495:0:18953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf501e00/0xffb8d925c20bc477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aec9 expref: 7 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784794.895503:0:18953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501e00, rc 0) 00000100:00100000:3.0:1787784794.895561:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3c44031-71ab-414a-bb9a-73f59e219c51+7:16776:x1874627634795776:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 163us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784794.895569:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 79 00000100:00100000:0.0:1787784794.900697:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784794.900783:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634795904 00000100:00100000:3.0:1787784794.900794:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634795904 00000100:00100000:3.0:1787784794.900849:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 80 00000100:00100000:3.0:1787784794.900869:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+7:16776:x1874627634795904:12345-192.168.202.59@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787784794.901243:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+8:16776:x1874627634795904:12345-192.168.202.59@tcp:501:mount.lustre.0 Request processed in 385us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784794.901249:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 80 00000100:00100000:2.0:1787784794.908324:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784794.908440:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634796032 00000100:00100000:1.0:1787784794.908451:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634796032 00000100:00100000:1.0:1787784794.908504:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 81 00000100:00100000:1.0:1787784794.908512:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+8:16776:x1874627634796032:12345-192.168.202.59@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787784794.910046:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+8:16776:x1874627634796032:12345-192.168.202.59@tcp:503:mount.lustre.0 Request processed in 1527us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784794.910059:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 81 00000100:00100000:3.0:1787784794.917696:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784794.917800:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634796160 00000100:00100000:0.0:1787784794.917810:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634796160 00000100:00100000:0.0:1787784794.917880:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 82 00000100:00100000:0.0:1787784794.917890:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3898c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+8:16794:x1874627634796160:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787784794.918189:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3898c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+8:16794:x1874627634796160:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 300us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784794.918197:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 82 00000100:00100000:3.0:1787784794.947765:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784794.947877:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634796288 00000100:00100000:1.0:1787784794.947887:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634796288 00000100:00100000:1.0:1787784794.947953:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 83 00000100:00100000:1.0:1787784794.947963:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3898850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+8:16794:x1874627634796288:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787784794.948513:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3898850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+8:16794:x1874627634796288:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 548us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784794.948523:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 83 00000100:00100000:2.0:1787784794.954239:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784794.954557:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634796416 00000100:00100000:3.0:1787784794.954568:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634796416 00000100:00100000:3.0:1787784794.954639:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 84 00000100:00100000:3.0:1787784794.954650:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3899c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3c44031-71ab-414a-bb9a-73f59e219c51+8:16776:x1874627634796416:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787784794.954666:0:18953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784794.954684:0:18953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf501a00/0xffb8d925c20bc47e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849aef3 expref: -99 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784794.954736:0:18953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf501a00/0xffb8d925c20bc47e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aef3 expref: 9 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784794.954748:0:18953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf501a00/0xffb8d925c20bc47e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aef3 expref: 9 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784794.954758:0:18953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501a00, rc 0) 00000100:00100000:3.0:1787784794.954828:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3899c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3c44031-71ab-414a-bb9a-73f59e219c51+9:16776:x1874627634796416:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 181us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784794.954835:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 84 00000100:00100000:2.0:1787784794.959573:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784794.959779:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634796544 00000100:00100000:1.0:1787784794.959792:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634796544 00000100:00100000:1.0:1787784794.959847:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 85 00000100:00100000:1.0:1787784794.959857:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+9:16776:x1874627634796544:12345-192.168.202.59@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787784794.959900:0:18954:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787784794.959918:0:18954:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787784794.959922:0:18954:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787784794.959925:0:18954:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787784794.959928:0:18954:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:2.0:1787784794.962194:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+9:16776:x1874627634796544:12345-192.168.202.59@tcp:256:mount.lustre.0 Request processed in 2328us (2621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784794.962219:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 85 00000100:00100000:2.0:1787784794.968669:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784794.968797:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634796672 00000100:00100000:0.0:1787784794.968807:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634796672 00000100:00100000:0.0:1787784794.968866:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 86 00000100:00100000:0.0:1787784794.968875:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+9:16776:x1874627634796672:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787784794.968892:0:18952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784794.968911:0:18952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bee88a00/0xffb8d925c20bc485 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849aefa expref: -99 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784794.968945:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bee88a00/0xffb8d925c20bc485 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aefa expref: 10 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784794.968957:0:18952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bee88a00/0xffb8d925c20bc485 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aefa expref: 10 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784794.968966:0:18952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88a00, rc 0) 00000100:00100000:0.0:1787784794.969031:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+10:16776:x1874627634796672:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 156us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784794.969037:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 86 00000100:00100000:1.0:1787784794.972064:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784794.974582:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634796800 00000100:00100000:2.0:1787784794.974597:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634796800 00000100:00100000:0.0:1787784794.974889:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 87 00000100:00100000:0.0:1787784794.974899:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+10:16776:x1874627634796800:12345-192.168.202.59@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787784794.975201:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+10:16776:x1874627634796800:12345-192.168.202.59@tcp:501:mount.lustre.0 Request processed in 304us (3146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784794.975208:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 87 00000100:00100000:1.0:1787784794.977295:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784794.977360:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634796928 00000100:00100000:3.0:1787784794.977498:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634796928 00000100:00100000:3.0:1787784794.977573:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 88 00000100:00100000:3.0:1787784794.977583:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3c44031-71ab-414a-bb9a-73f59e219c51+10:16776:x1874627634796928:12345-192.168.202.59@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787784794.977819:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3c44031-71ab-414a-bb9a-73f59e219c51+10:16776:x1874627634796928:12345-192.168.202.59@tcp:503:mount.lustre.0 Request processed in 239us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784794.977825:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 88 00000100:00100000:0.0:1787784794.983959:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784794.984137:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634797056 00000100:00100000:1.0:1787784794.984148:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634797056 00000100:00100000:1.0:1787784794.984239:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 89 00000100:00100000:1.0:1787784794.984249:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+10:16796:x1874627634797056:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787784794.984554:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+10:16796:x1874627634797056:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 305us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784794.984561:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 89 00000100:00100000:1.0:1787784794.998636:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784794.998727:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634797184 00000100:00100000:3.0:1787784794.998738:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634797184 00000100:00100000:3.0:1787784794.998793:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 90 00000100:00100000:3.0:1787784794.998803:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3c44031-71ab-414a-bb9a-73f59e219c51+10:16796:x1874627634797184:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787784794.999070:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3c44031-71ab-414a-bb9a-73f59e219c51+10:16796:x1874627634797184:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 267us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784794.999078:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 90 00000100:00100000:3.0:1787784795.008696:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784795.009070:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634797312 00000100:00100000:2.0:1787784795.009081:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634797312 00000100:00100000:2.0:1787784795.009132:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:2.0:1787784795.009140:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197015a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2361:x1874627634797312:12345-192.168.202.59@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787784795.009179:0:19667:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c1ecce4d-d802-4177-ac8b-b53f5aa1fa65@192.168.202.59@tcp t0 exp 0000000000000000 cur 609 last 0 00000020:00000080:2.0:1787784795.010175:0:19667:0:(genops.c:1385:class_connect()) connect: client c1ecce4d-d802-4177-ac8b-b53f5aa1fa65, cookie 0xffb8d925c20bc48c 00000004:00100000:2.0:1787784795.010213:0:19667:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:2.0:1787784795.010219:0:19667:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:2.0:1787784795.065621:0:19667:0:(import.c:65:import_set_state_nolock()) ffff943081807000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787784795.065754:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197015a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+6:2361:x1874627634797312:12345-192.168.202.59@tcp:38:mount.lustre.0 Request processed in 56612us (57068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784795.065766:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:1.0:1787784795.070076:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784795.070184:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784795.070966:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634797568 00000100:00100000:0.0:1787784795.070976:0:18961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634797568 00000100:00100000:0.0:1787784795.071098:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634797440 00000100:00100000:0.0:1787784795.071102:0:18961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634797440 00000100:00080000:1.0:1787784795.071157:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784795.071251:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:3.0:1787784795.071264:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189161a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+7:16776:x1874627634797568:12345-192.168.202.59@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787784795.071312:0:18960:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787784795.071426:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189161a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+7:16776:x1874627634797568:12345-192.168.202.59@tcp:41:mount.lustre.0 Request processed in 164us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784795.071434:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:3.0:1787784795.071463:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:3.0:1787784795.071471:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189162580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+6:0:x1874627634797440:12345-192.168.202.59@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787784795.071484:0:18960:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787784795.071507:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189162580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+6:0:x1874627634797440:12345-192.168.202.59@tcp:41:mount.lustre.0 Request processed in 37us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784795.071513:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:1.0:1787784795.074756:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784795.074923:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634797696 00000100:00100000:2.0:1787784795.074934:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634797696 00000100:00100000:2.0:1787784795.075027:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:2.0:1787784795.075038:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189161e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+6:16776:x1874627634797696:12345-192.168.202.59@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787784795.075132:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189161e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+6:16776:x1874627634797696:12345-192.168.202.59@tcp:40:mount.lustre.0 Request processed in 96us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784795.075139:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:1.0:1787784795.079495:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784795.079547:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784795.079791:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634797824 00000100:00100000:0.0:1787784795.079803:0:19646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634797824 00000100:00100000:0.0:1787784795.079842:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634797952 00000100:00100000:0.0:1787784795.079845:0:19646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634797952 00000100:00100000:0.0:1787784795.079871:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:0.0:1787784795.079880:0:19646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431891612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1874627634797824:12345-192.168.202.59@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787784795.079918:0:19646:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c1ecce4d-d802-4177-ac8b-b53f5aa1fa65@192.168.202.59@tcp t0 exp 0000000000000000 cur 609 last 0 00000020:00000080:0.0:1787784795.079947:0:19646:0:(genops.c:1385:class_connect()) connect: client c1ecce4d-d802-4177-ac8b-b53f5aa1fa65, cookie 0xffb8d925c20bc493 00002000:00100000:0.0:1787784795.079962:0:19646:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c1ecce4d-d802-4177-ac8b-b53f5aa1fa65/ffff9431be3f0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787784795.079974:0:19646:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1787784795.080348:0:19646:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787784795.080399:0:19646:0:(import.c:65:import_set_state_nolock()) ffff9431be3f1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784795.080472:0:19646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431891612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+6:2361:x1874627634797824:12345-192.168.202.59@tcp:8:mount.lustre.0 Request processed in 591us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784795.080480:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:0.0:1787784795.080499:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:0.0:1787784795.080505:0:19646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431891630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1874627634797952:12345-192.168.202.59@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787784795.080521:0:19646:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c1ecce4d-d802-4177-ac8b-b53f5aa1fa65@192.168.202.59@tcp t0 exp 0000000000000000 cur 609 last 0 00000020:00000080:0.0:1787784795.080553:0:19646:0:(genops.c:1385:class_connect()) connect: client c1ecce4d-d802-4177-ac8b-b53f5aa1fa65, cookie 0xffb8d925c20bc49a 00002000:00100000:0.0:1787784795.080560:0:19646:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c1ecce4d-d802-4177-ac8b-b53f5aa1fa65/ffff9431be3f1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787784795.080576:0:19646:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1787784795.080712:0:19646:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787784795.080730:0:19646:0:(import.c:65:import_set_state_nolock()) ffff9431be3f7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784795.080758:0:19646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431891630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+6:2361:x1874627634797952:12345-192.168.202.59@tcp:8:mount.lustre.0 Request processed in 251us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784795.080764:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:1.0:1787784795.084490:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784795.084613:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634798080 00000100:00100000:3.0:1787784795.084624:0:18962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634798080 00000100:00100000:3.0:1787784795.084681:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:3.0:1787784795.084692:0:18962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189162940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+6:16776:x1874627634798080:12345-192.168.202.59@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787784795.086947:0:18962:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2155us 00000004:00200000:1.0:1787784795.097821:0:18962:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787784795.098002:0:18962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189162940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+6:16776:x1874627634798080:12345-192.168.202.59@tcp:33:mount.lustre.0 Request processed in 13306us (13521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784795.098014:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:0.0:1787784795.352721:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784795.352997:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634798208 00000100:00100000:2.0:1787784795.353012:0:18961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634798208 00000100:00100000:2.0:1787784795.353128:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:2.0:1787784795.353155:0:18961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+6:16817:x1874627634798208:12345-192.168.202.59@tcp:101:mkdir.0 00010000:00010000:2.0:1787784795.354003:0:18961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784795.354043:0:18961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc4a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849af24 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784795.354677:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794a00/0xffb8d925c20bc4a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784795.354700:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794a00/0xffb8d925c20bc4a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784795.354721:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794a00/0xffb8d925c20bc4a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784795.355457:0:18961:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787784795.355464:0:18961:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787784795.356808:0:18961:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794a00/0xffb8d925c20bc4a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784795.356888:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc4a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849af24 expref: 8 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784795.356915:0:18961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794a00/0xffb8d925c20bc4a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849af24 expref: 7 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784795.356927:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9431861c2800) 00010000:00010000:2.0:1787784795.356930:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787784795.356935:0:18961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431be794a00, rc 0) 00000100:00100000:2.0:1787784795.357054:0:18961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+7:16817:x1874627634798208:12345-192.168.202.59@tcp:101:mkdir.0 Request processed in 3908us (4348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784795.357075:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:2.0:1787784795.445228:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17693f43-cfcf-4d1e-8495-73723b171a31:3296:1874627643186048:0@lo:400:kworker.0 00000100:00100000:2.0:1787784795.445343:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784795.445451:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643186560:0@lo:400:kworker.0 00000100:00100000:2.0:1787784795.445485:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784795.445517:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784795.445524:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643186432:0@lo:400:kworker.0 00000100:00100000:2.0:1787784795.445551:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784795.445592:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643186560 00000100:00100000:2.0:1787784795.445623:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643186560 00000100:00100000:2.0:1787784795.445699:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643186432 00000100:00100000:2.0:1787784795.445703:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643186432 00000100:00100000:2.0:1787784795.445726:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784795.445735:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643186560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784795.445798:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643186560:12345-0@lo:400:kworker.0 Request processed in 63us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784795.445806:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784795.445823:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787784795.445829:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643186432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784795.445957:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643186048 00000100:00100000:0.0:1787784795.445962:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643186048 00000100:00100000:0.0:1787784795.445996:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787784795.446004:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+19:3296:x1874627643186048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784795.446039:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+19:3296:x1874627643186048:12345-0@lo:400:kworker.0 Request processed in 38us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784795.446045:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1787784795.446097:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784795.446149:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643186432:0@lo:400:kworker.0 00000100:00100000:0.0:1787784795.446160:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17693f43-cfcf-4d1e-8495-73723b171a31:3296:1874627643186048:0@lo:400:kworker.0 00000100:00100000:0.0:1787784795.446179:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643186560:0@lo:400:kworker.0 00000100:00100000:3.0:1787784795.446290:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643186176:0@lo:400:kworker.0 00000100:00100000:3.0:1787784795.446330:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784795.446387:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643186688:0@lo:400:kworker.0 00000100:00100000:3.0:1787784795.446413:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784795.446434:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784795.446441:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643186304:0@lo:400:kworker.0 00000100:00100000:3.0:1787784795.446462:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784795.446497:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643186688 00000100:00100000:3.0:1787784795.446517:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643186688 00000100:00100000:3.0:1787784795.446551:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787784795.446557:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431970161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643186688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784795.446606:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431970161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643186688:12345-0@lo:400:kworker.0 Request processed in 39us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784795.446613:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787784795.446644:0:19645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643186176 00000100:00100000:3.0:1787784795.446648:0:19645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643186176 00000100:00100000:3.0:1787784795.446674:0:19645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643186304 00000100:00100000:3.0:1787784795.446678:0:19645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643186304 00000100:00100000:3.0:1787784795.446698:0:19645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787784795.446704:0:19645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197016d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643186176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784795.446737:0:19645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197016d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643186176:12345-0@lo:400:kworker.0 Request processed in 33us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784795.446743:0:19645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787784795.446753:0:19645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787784795.446759:0:19645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197014f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643186304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784795.446784:0:19645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197014f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643186304:12345-0@lo:400:kworker.0 Request processed in 26us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784795.446789:0:19645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787784795.446811:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787784795.446814:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784795.446832:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643186304:0@lo:400:kworker.0 00000100:00100000:3.0:1787784795.446842:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643186176:0@lo:400:kworker.0 00000100:00100000:3.0:1787784795.446850:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643186688:0@lo:400:kworker.0 00000100:00100000:2.0:1787784795.446955:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643186432:12345-0@lo:400:kworker.0 Request processed in 25us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784795.446964:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787784795.447397:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189163840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643186816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784795.447437:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784795.447495:0:19647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643186816 00000100:00100000:1.0:1787784795.447500:0:19647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643186816 00000100:00100000:1.0:1787784795.447531:0:19647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784795.447539:0:19647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189160780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1874627643186816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784795.447557:0:19647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784795.453279:0:19647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189160780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1874627643186816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5722us (5823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784795.453302:0:19647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784795.453444:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189163840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643186816:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787784795.570474:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c1ecce4d-d802-4177-ac8b-b53f5aa1fa65 00000001:00100000:0.0:1787784795.592021:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c1ecce4d-d802-4177-ac8b-b53f5aa1fa65 00000001:00080000:0.0:1787784795.592052:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00010000:00010000:1.0:1787784795.636930:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787784796.217732:0:18992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787784796.662182:0:20630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784797.429339:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784797.430010:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634798336 00000100:00100000:0.0:1787784797.430022:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634798336 00000100:00100000:0.0:1787784797.430120:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:0.0:1787784797.430131:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197015680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+7:16869:x1874627634798336:12345-192.168.202.59@tcp:41:lfs.0 00000004:00000024:0.0:1787784797.430192:0:19667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787784797.430305:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197015680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+7:16869:x1874627634798336:12345-192.168.202.59@tcp:41:lfs.0 Request processed in 178us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784797.430310:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00080000:3.0:1787784797.430476:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784797.434863:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784797.434992:0:19647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634798464 00000100:00100000:3.0:1787784797.435017:0:19647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634798464 00000100:00100000:3.0:1787784797.435113:0:19647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:3.0:1787784797.435125:0:19647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189163840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+5:16869:x1874627634798464:12345-192.168.202.59@tcp:13:lfs.0 00002000:00000024:3.0:1787784797.435180:0:19647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1787784797.435299:0:19647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189163840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+5:16869:x1874627634798464:12345-192.168.202.59@tcp:13:lfs.0 Request processed in 177us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784797.435309:0:19647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00080000:0.0:1787784797.435852:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784797.438401:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784797.438568:0:19647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634798592 00000100:00100000:3.0:1787784797.438591:0:19647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634798592 00000100:00100000:3.0:1787784797.438693:0:19647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:3.0:1787784797.438706:0:19647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+5:16869:x1874627634798592:12345-192.168.202.59@tcp:13:lfs.0 00002000:00000024:3.0:1787784797.438764:0:19647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784797.439056:0:19647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+5:16869:x1874627634798592:12345-192.168.202.59@tcp:13:lfs.0 Request processed in 352us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784797.439066:0:19647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00080000:0.0:1787784797.439347:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784797.654165:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784797.654423:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634798720 00000100:00100000:0.0:1787784797.654436:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634798720 00000100:00100000:0.0:1787784797.654513:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 92 00000100:00100000:0.0:1787784797.654526:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+10:16899:x1874627634798720:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787784797.654551:0:18952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784797.654595:0:18952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bee88600/0xffb8d925c20bc4af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849af2b expref: -99 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784797.654636:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bee88600/0xffb8d925c20bc4af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849af2b expref: 11 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784797.654649:0:18952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bee88600/0xffb8d925c20bc4af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849af2b expref: 11 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784797.654659:0:18952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88600, rc 0) 00000100:00100000:0.0:1787784797.654742:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+11:16899:x1874627634798720:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 218us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784797.654750:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 92 00000100:00100000:1.0:1787784797.670815:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784797.670926:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634798848 00000100:00100000:3.0:1787784797.670939:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634798848 00000100:00100000:3.0:1787784797.671011:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 93 00000100:00100000:3.0:1787784797.671023:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3c44031-71ab-414a-bb9a-73f59e219c51+11:16899:x1874627634798848:12345-192.168.202.59@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787784797.671627:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3c44031-71ab-414a-bb9a-73f59e219c51+11:16899:x1874627634798848:12345-192.168.202.59@tcp:501:mount.lustre.0 Request processed in 603us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784797.671639:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 93 00000100:00100000:2.0:1787784797.683360:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784797.683536:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634798976 00000100:00100000:1.0:1787784797.683550:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634798976 00000100:00100000:1.0:1787784797.683650:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 94 00000100:00100000:1.0:1787784797.683662:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+11:16899:x1874627634798976:12345-192.168.202.59@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787784797.684825:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+11:16899:x1874627634798976:12345-192.168.202.59@tcp:503:mount.lustre.0 Request processed in 1155us (1473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784797.684848:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 94 00010000:00010000:2.0:1787784797.685329:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784797.699056:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784797.699490:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634799104 00000100:00100000:0.0:1787784797.699504:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634799104 00000100:00100000:0.0:1787784797.699618:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 95 00000100:00100000:0.0:1787784797.699630:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+11:16906:x1874627634799104:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787784797.700280:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+11:16906:x1874627634799104:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 649us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784797.700290:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 95 00000100:00100000:1.0:1787784797.733240:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784797.733757:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634799232 00000100:00100000:0.0:1787784797.733771:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634799232 00000100:00100000:0.0:1787784797.733857:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 96 00000100:00100000:0.0:1787784797.733870:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+11:16906:x1874627634799232:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787784797.734433:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+11:16906:x1874627634799232:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 562us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784797.734444:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 96 00000100:00100000:2.0:1787784797.751858:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784797.752057:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634799360 00000100:00100000:0.0:1787784797.752072:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634799360 00000100:00100000:0.0:1787784797.752162:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 97 00000100:00100000:0.0:1787784797.752174:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+11:16899:x1874627634799360:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787784797.752199:0:18952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784797.752222:0:18952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bee88c00/0xffb8d925c20bc4b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849af55 expref: -99 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784797.752259:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bee88c00/0xffb8d925c20bc4b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849af55 expref: 12 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784797.752273:0:18952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bee88c00/0xffb8d925c20bc4b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849af55 expref: 12 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784797.752284:0:18952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88c00, rc 0) 00000100:00100000:0.0:1787784797.752427:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+12:16899:x1874627634799360:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 255us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784797.752435:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 97 00000100:00100000:2.0:1787784797.761511:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784797.762979:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634799488 00000100:00100000:3.0:1787784797.763020:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634799488 00000100:00100000:3.0:1787784797.763118:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 98 00000100:00100000:2.0:1787784797.764504:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3c44031-71ab-414a-bb9a-73f59e219c51+12:16899:x1874627634799488:12345-192.168.202.59@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787784797.764548:0:18953:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787784797.768001:0:18953:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787784797.768017:0:18953:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787784797.768021:0:18953:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787784797.768024:0:18953:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:3.0:1787784797.775912:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3c44031-71ab-414a-bb9a-73f59e219c51+12:16899:x1874627634799488:12345-192.168.202.59@tcp:256:mount.lustre.0 Request processed in 11626us (14398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784797.775935:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 98 00000100:00100000:0.0:1787784797.791675:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784797.791859:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634799616 00000100:00100000:1.0:1787784797.791872:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634799616 00000100:00100000:1.0:1787784797.791946:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 99 00000100:00100000:1.0:1787784797.791959:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+12:16899:x1874627634799616:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787784797.792016:0:18954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784797.792042:0:18954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431829d0000/0xffb8d925c20bc4bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849af5c expref: -99 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784797.792082:0:18954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431829d0000/0xffb8d925c20bc4bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849af5c expref: 13 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784797.792096:0:18954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431829d0000/0xffb8d925c20bc4bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849af5c expref: 13 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784797.792107:0:18954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d0000, rc 0) 00000100:00100000:1.0:1787784797.792196:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+13:16899:x1874627634799616:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 239us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784797.792204:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 99 00000100:00100000:2.0:1787784797.803165:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784797.803334:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634799744 00000100:00100000:3.0:1787784797.803346:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634799744 00000100:00100000:3.0:1787784797.803460:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 100 00000100:00100000:3.0:1787784797.803471:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b389e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3c44031-71ab-414a-bb9a-73f59e219c51+13:16899:x1874627634799744:12345-192.168.202.59@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787784797.803866:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b389e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3c44031-71ab-414a-bb9a-73f59e219c51+13:16899:x1874627634799744:12345-192.168.202.59@tcp:501:mount.lustre.0 Request processed in 395us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784797.803875:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 100 00000100:00100000:2.0:1787784797.806239:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784797.806422:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634799872 00000100:00100000:0.0:1787784797.806434:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634799872 00000100:00100000:0.0:1787784797.806496:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 101 00000100:00100000:0.0:1787784797.806506:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+13:16899:x1874627634799872:12345-192.168.202.59@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787784797.807226:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+13:16899:x1874627634799872:12345-192.168.202.59@tcp:503:mount.lustre.0 Request processed in 715us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784797.807238:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 101 00000100:00100000:0.0:1787784797.812953:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784797.813439:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634800000 00000100:00100000:1.0:1787784797.813455:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634800000 00000100:00100000:1.0:1787784797.813534:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 102 00000100:00100000:1.0:1787784797.813547:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+13:16911:x1874627634800000:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787784797.813998:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+13:16911:x1874627634800000:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 452us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784797.814145:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 102 00000100:00100000:2.0:1787784797.848649:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784797.848929:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634800128 00000100:00100000:0.0:1787784797.848942:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634800128 00000100:00100000:0.0:1787784797.849062:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 103 00000100:00100000:0.0:1787784797.849074:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+13:16911:x1874627634800128:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787784797.849474:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+13:16911:x1874627634800128:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 401us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784797.849482:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 103 00000100:00100000:2.0:1787784797.870292:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784797.870470:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634800256 00000100:00100000:0.0:1787784797.870486:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634800256 00000100:00100000:0.0:1787784797.870555:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:0.0:1787784797.870566:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2361:x1874627634800256:12345-192.168.202.59@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787784797.870615:0:18959:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6bc1394c-7442-4c5c-9873-3edd9faa1a10@192.168.202.59@tcp t0 exp 0000000000000000 cur 612 last 0 00000020:00000080:0.0:1787784797.870661:0:18959:0:(genops.c:1385:class_connect()) connect: client 6bc1394c-7442-4c5c-9873-3edd9faa1a10, cookie 0xffb8d925c20bc4c4 00000004:00100000:0.0:1787784797.870719:0:18959:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:0.0:1787784797.870886:0:18959:0:(import.c:65:import_set_state_nolock()) ffff9431be3f5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784797.870989:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6bc1394c-7442-4c5c-9873-3edd9faa1a10+6:2361:x1874627634800256:12345-192.168.202.59@tcp:38:mount.lustre.0 Request processed in 422us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784797.870998:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:2.0:1787784797.876675:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784797.876740:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784797.877241:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634800512 00000100:00100000:0.0:1787784797.877255:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634800512 00000100:00100000:0.0:1787784797.877348:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634800384 00000100:00100000:0.0:1787784797.877352:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634800384 00000100:00100000:0.0:1787784797.877421:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:0.0:1787784797.877433:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6bc1394c-7442-4c5c-9873-3edd9faa1a10+7:16899:x1874627634800512:12345-192.168.202.59@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787784797.877476:0:19667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1787784797.877562:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784797.877588:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6bc1394c-7442-4c5c-9873-3edd9faa1a10+7:16899:x1874627634800512:12345-192.168.202.59@tcp:41:mount.lustre.0 Request processed in 144us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784797.877598:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:0.0:1787784797.877633:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:0.0:1787784797.877641:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6bc1394c-7442-4c5c-9873-3edd9faa1a10+6:0:x1874627634800384:12345-192.168.202.59@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787784797.877654:0:19667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787784797.877680:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6bc1394c-7442-4c5c-9873-3edd9faa1a10+6:0:x1874627634800384:12345-192.168.202.59@tcp:41:mount.lustre.0 Request processed in 40us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784797.877686:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:3.0:1787784797.879963:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784797.880270:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634800640 00000100:00100000:2.0:1787784797.880283:0:18961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634800640 00000100:00100000:2.0:1787784797.880360:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:2.0:1787784797.880806:0:18961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431970152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6bc1394c-7442-4c5c-9873-3edd9faa1a10+6:16899:x1874627634800640:12345-192.168.202.59@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787784797.881446:0:18961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431970152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6bc1394c-7442-4c5c-9873-3edd9faa1a10+6:16899:x1874627634800640:12345-192.168.202.59@tcp:40:mount.lustre.0 Request processed in 644us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784797.881457:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:2.0:1787784797.899311:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784797.899389:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784797.899430:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784797.900017:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634801024 00000100:00100000:1.0:1787784797.900031:0:18963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634801024 00000100:00100000:1.0:1787784797.900102:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:1.0:1787784797.900115:0:18963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6bc1394c-7442-4c5c-9873-3edd9faa1a10+6:16899:x1874627634801024:12345-192.168.202.59@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787784797.900589:0:18963:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787784797.900795:0:18963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6bc1394c-7442-4c5c-9873-3edd9faa1a10+6:16899:x1874627634801024:12345-192.168.202.59@tcp:33:mount.lustre.0 Request processed in 681us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784797.900807:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:3.0:1787784797.901823:0:19645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634800768 00000100:00100000:3.0:1787784797.901838:0:19645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634800768 00000100:00100000:3.0:1787784797.901888:0:19645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634800896 00000100:00100000:3.0:1787784797.901893:0:19645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634800896 00000100:00100000:3.0:1787784797.901923:0:19645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:3.0:1787784797.901932:0:19645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1874627634800768:12345-192.168.202.59@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787784797.901973:0:19645:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6bc1394c-7442-4c5c-9873-3edd9faa1a10@192.168.202.59@tcp t0 exp 0000000000000000 cur 612 last 0 00000020:00000080:3.0:1787784797.902026:0:19645:0:(genops.c:1385:class_connect()) connect: client 6bc1394c-7442-4c5c-9873-3edd9faa1a10, cookie 0xffb8d925c20bc4cb 00002000:00100000:3.0:1787784797.902041:0:19645:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6bc1394c-7442-4c5c-9873-3edd9faa1a10/ffff9431b98af000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787784797.902056:0:19645:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:3.0:1787784797.902672:0:19645:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787784797.902734:0:19645:0:(import.c:65:import_set_state_nolock()) ffff9431b98ab000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787784797.903422:0:19645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6bc1394c-7442-4c5c-9873-3edd9faa1a10+6:2361:x1874627634800768:12345-192.168.202.59@tcp:8:mount.lustre.0 Request processed in 1485us (4026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784797.903435:0:19645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:1.0:1787784797.903657:0:20123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:1.0:1787784797.903666:0:20123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2361:x1874627634800896:12345-192.168.202.59@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787784797.903714:0:20123:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6bc1394c-7442-4c5c-9873-3edd9faa1a10@192.168.202.59@tcp t0 exp 0000000000000000 cur 612 last 0 00000020:00000080:1.0:1787784797.903746:0:20123:0:(genops.c:1385:class_connect()) connect: client 6bc1394c-7442-4c5c-9873-3edd9faa1a10, cookie 0xffb8d925c20bc4d2 00002000:00100000:1.0:1787784797.903759:0:20123:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6bc1394c-7442-4c5c-9873-3edd9faa1a10/ffff94308349b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787784797.903770:0:20123:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1787784797.904025:0:20123:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787784797.904058:0:20123:0:(import.c:65:import_set_state_nolock()) ffff94308349b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784797.904117:0:20123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6bc1394c-7442-4c5c-9873-3edd9faa1a10+6:2361:x1874627634800896:12345-192.168.202.59@tcp:8:mount.lustre.0 Request processed in 449us (4685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784797.904671:0:20123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:2.0:1787784798.085198:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784798.085430:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634801152 00000100:00100000:0.0:1787784798.085443:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634801152 00000100:00100000:0.0:1787784798.085548:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:0.0:1787784798.085558:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6bc1394c-7442-4c5c-9873-3edd9faa1a10+6:16933:x1874627634801152:12345-192.168.202.59@tcp:101:mkdir.0 00010000:00010000:0.0:1787784798.085597:0:19667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784798.085645:0:19667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bc4d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849af86 expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784798.085732:0:19667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bc4e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784798.085750:0:19667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bc4e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784798.085765:0:19667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bc4e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784798.086942:0:19667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787784798.086953:0:19667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787784798.087113:0:19667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bc4e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784798.087351:0:19667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bc4d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849af86 expref: 8 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784798.087404:0:19667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bc4e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849af86 expref: 7 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784798.087415:0:19667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9431861c2800) 00010000:00010000:0.0:1787784798.087418:0:19667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784798.087423:0:19667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89400, rc 0) 00000100:00100000:0.0:1787784798.087700:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6bc1394c-7442-4c5c-9873-3edd9faa1a10+7:16933:x1874627634801152:12345-192.168.202.59@tcp:101:mkdir.0 Request processed in 2140us (2515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784798.087711:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 14 00010000:00010000:1.0:1787784798.708689:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784799.550793:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784799.550825:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643186944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784799.550927:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784799.551055:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643186944 00000100:00100000:1.0:1787784799.551065:0:19648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643186944 00000100:00100000:1.0:1787784799.551167:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787784799.551180:0:19648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643186944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784799.551229:0:19648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1787784799.551287:0:19648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643186944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784799.551295:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1787784799.551736:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784799.551859:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643186944:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787784799.745891:0:20630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787784800.110084:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6bc1394c-7442-4c5c-9873-3edd9faa1a10 00000001:00100000:3.0:1787784800.110118:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c1ecce4d-d802-4177-ac8b-b53f5aa1fa65 00000100:00100000:3.0:1787784800.565461:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643187072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784800.565575:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784800.565682:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643187072 00000100:00100000:3.0:1787784800.565692:0:19648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643187072 00000100:00100000:3.0:1787784800.565770:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787784800.565780:0:19648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431970143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643187072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784800.565830:0:19648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784800.565884:0:19648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431970143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643187072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784800.565892:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787784800.565919:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787784800.565955:0:3296:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1787784800.569131:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf698780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643187328:0@lo:400:kworker.0 00000100:00100000:3.0:1787784800.570488:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643187072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784800.571656:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf699e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17693f43-cfcf-4d1e-8495-73723b171a31:3293:1874627643187200:0@lo:400:kworker.0 00000100:00100000:3.0:1787784800.572053:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf6992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643187456:0@lo:400:kworker.0 00000100:00100000:2.0:1787784800.572650:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784800.572711:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf69a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643187712:0@lo:400:kworker.0 00000100:00100000:2.0:1787784800.572742:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784800.572798:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643187712 00000100:00100000:2.0:1787784800.572807:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643187712 00000100:00100000:2.0:1787784800.572880:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787784800.572894:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643187712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784800.572961:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643187712:12345-0@lo:400:kworker.0 Request processed in 72us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784800.572984:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787784800.573410:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf69a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643187712:0@lo:400:kworker.0 00000100:00100000:2.0:1787784800.573468:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643187200 00000100:00100000:2.0:1787784800.573472:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643187200 00000100:00100000:2.0:1787784800.573504:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787784800.573512:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+19:3293:x1874627643187200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784800.573569:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+19:3293:x1874627643187200:12345-0@lo:400:kworker.0 Request processed in 58us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784800.573576:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787784800.573614:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf699e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17693f43-cfcf-4d1e-8495-73723b171a31:3293:1874627643187200:0@lo:400:kworker.0 00000100:00100000:2.0:1787784800.573634:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf698f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643187584:0@lo:400:kworker.0 00000100:00100000:2.0:1787784800.573676:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787784800.573717:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784800.584683:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643187584 00000100:00100000:1.0:1787784800.584701:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643187584 00000100:00100000:1.0:1787784800.584807:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787784800.584820:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf699e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643187584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784800.584955:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf699e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643187584:12345-0@lo:400:kworker.0 Request processed in 139us (11278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784800.584963:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787784800.585008:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784800.587076:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf698f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643187584:0@lo:400:kworker.0 00000100:00100000:1.0:1787784800.587189:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784800.595392:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784800.595498:0:19645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643187328 00000100:00100000:3.0:1787784800.595509:0:19645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643187328 00000100:00100000:3.0:1787784800.595587:0:19645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787784800.595599:0:19645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189162d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643187328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784800.595677:0:19645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189162d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643187328:12345-0@lo:400:kworker.0 Request processed in 80us (8488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784800.595704:0:19645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787784800.595737:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643187456 00000100:00100000:3.0:1787784800.595741:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643187456 00000100:00100000:3.0:1787784800.595770:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787784800.595776:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643187456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784800.595813:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643187456:12345-0@lo:400:kworker.0 Request processed in 37us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784800.595819:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787784800.598233:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf6992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643187456:0@lo:400:kworker.0 00000100:00100000:3.0:1787784800.598314:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf698780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643187328:0@lo:400:kworker.0 00000001:00100000:2.0:1787784800.697733:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6bc1394c-7442-4c5c-9873-3edd9faa1a10 00000001:00100000:2.0:1787784800.729939:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6bc1394c-7442-4c5c-9873-3edd9faa1a10 00010000:00010000:0.0:1787784800.756592:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787784801.665182:0:20930:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787784801.794038:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784802.810017:0:20630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784803.066743:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784803.066807:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784803.066848:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784803.066866:0:20123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634801536 00000100:00100000:3.0:1787784803.066873:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784803.066881:0:20123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634801536 00000100:00100000:3.0:1787784803.066891:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784803.066910:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784803.066937:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784803.066953:0:20123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634802048 00000100:00100000:2.0:1787784803.066956:0:20123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634802048 00000100:00100000:3.0:1787784803.066960:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634801792 00000100:00100000:3.0:1787784803.066963:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634801792 00000100:00100000:2.0:1787784803.066973:0:20123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634801664 00000100:00100000:2.0:1787784803.066975:0:20123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634801664 00000100:00100000:2.0:1787784803.066987:0:20123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634801920 00000100:00100000:2.0:1787784803.066989:0:20123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634801920 00000100:00100000:3.0:1787784803.066992:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634801408 00000100:00100000:3.0:1787784803.066995:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634801408 00000100:00100000:2.0:1787784803.067006:0:20123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:3.0:1787784803.067013:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:2.0:1787784803.067018:0:20123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197014b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+5:2363:x1874627634801536:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784803.067020:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197016940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6bc1394c-7442-4c5c-9873-3edd9faa1a10+6:2363:x1874627634801792:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784803.067107:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634801280 00000100:00100000:1.0:1787784803.067112:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634801280 00000100:00100000:1.0:1787784803.067146:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 105 00000100:00100000:1.0:1787784803.067154:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+13:2363:x1874627634801280:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784803.070244:0:19643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:3.0:1787784803.070275:0:19643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6bc1394c-7442-4c5c-9873-3edd9faa1a10+5:2363:x1874627634802048:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784803.070438:0:19643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6bc1394c-7442-4c5c-9873-3edd9faa1a10+5:2363:x1874627634802048:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 177us (3562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784803.070448:0:19643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:3.0:1787784803.070478:0:19643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:3.0:1787784803.070487:0:19643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+5:2363:x1874627634801664:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784803.070518:0:19643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+5:2363:x1874627634801664:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 33us (3607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784803.070535:0:19643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:3.0:1787784803.070549:0:19643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:3.0:1787784803.070559:0:19643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197114000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6bc1394c-7442-4c5c-9873-3edd9faa1a10+5:2363:x1874627634801920:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784803.070589:0:19643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197114000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6bc1394c-7442-4c5c-9873-3edd9faa1a10+5:2363:x1874627634801920:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 32us (3650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784803.070595:0:19643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:3.0:1787784803.070627:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:3.0:1787784803.070636:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197014780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+6:2363:x1874627634801408:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784803.070667:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197014780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+6:2363:x1874627634801408:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 32us (3774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784803.070674:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:3.0:1787784803.070810:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197016940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6bc1394c-7442-4c5c-9873-3edd9faa1a10+6:2363:x1874627634801792:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 3789us (3960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784803.070817:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:2.0:1787784803.071779:0:20123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197014b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+5:2363:x1874627634801536:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 4752us (4960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784803.071792:0:20123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00080000:2.0:1787784803.071828:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787784803.071836:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787784803.071839:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784803.074533:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+13:2363:x1874627634801280:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 7350us (7777us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784803.074559:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 105 00010000:00010000:3.0:1787784803.835951:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784804.660743:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784804.660783:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189161680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643187840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784804.660908:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784804.661058:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643187840 00000100:00100000:1.0:1787784804.661070:0:19648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643187840 00000100:00100000:1.0:1787784804.661158:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787784804.661170:0:19648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643187840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784804.661221:0:19648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1787784804.661281:0:19648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643187840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784804.661310:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787784804.661386:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784804.661437:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189161680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643187840:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787784804.852534:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784805.684983:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784805.685020:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643187968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784805.685137:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784805.685220:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643187968 00000100:00100000:0.0:1787784805.685230:0:19648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643187968 00000100:00100000:0.0:1787784805.685305:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787784805.685316:0:19648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643187968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784805.685361:0:19648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787784805.685446:0:19648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643187968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784805.685454:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787784805.685538:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643187968:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787784805.689868:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784805.689912:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf69b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643188480:0@lo:400:kworker.0 00000100:00100000:2.0:1787784805.690012:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784805.690283:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787784805.690292:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf698b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17693f43-cfcf-4d1e-8495-73723b171a31:3295:1874627643188096:0@lo:400:kworker.0 00000100:00100000:2.0:1787784805.690330:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784805.690387:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf69b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643188608:0@lo:400:kworker.0 00000100:00100000:2.0:1787784805.690414:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784805.690443:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf69a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643188224:0@lo:400:kworker.0 00000100:00100000:2.0:1787784805.690473:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784805.690581:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784805.690587:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf699680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643188352:0@lo:400:kworker.0 00000100:00100000:2.0:1787784805.690610:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784805.690645:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643188480 00000100:00100000:2.0:1787784805.690654:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643188480 00000100:00100000:2.0:1787784805.690712:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643188608 00000100:00100000:2.0:1787784805.690715:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643188608 00000100:00100000:2.0:1787784805.690730:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643188352 00000100:00100000:2.0:1787784805.690733:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643188352 00000100:00100000:2.0:1787784805.690748:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787784805.690757:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643188480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784805.690955:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643188480:12345-0@lo:400:kworker.0 Request processed in 198us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784805.690964:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787784805.690984:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787784805.690991:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf699a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643188608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784805.691018:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf699a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643188608:12345-0@lo:400:kworker.0 Request processed in 29us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784805.691025:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787784805.691035:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787784805.691108:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf6992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643188352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784805.691145:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf6992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643188352:12345-0@lo:400:kworker.0 Request processed in 95us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784805.691152:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787784805.691173:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643188096 00000100:00100000:2.0:1787784805.691177:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643188096 00000100:00100000:2.0:1787784805.691202:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787784805.691209:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+19:3295:x1874627643188096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784805.691239:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+19:3295:x1874627643188096:12345-0@lo:400:kworker.0 Request processed in 30us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784805.691245:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787784805.691280:0:19643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643188224 00000100:00100000:2.0:1787784805.691284:0:19643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643188224 00000100:00100000:2.0:1787784805.691312:0:19643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787784805.691319:0:19643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf698780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643188224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784805.691350:0:19643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf698780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643188224:12345-0@lo:400:kworker.0 Request processed in 33us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784805.691357:0:19643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1787784805.691401:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784805.691443:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf699680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643188352:0@lo:400:kworker.0 00000100:00100000:2.0:1787784805.691455:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf69a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643188224:0@lo:400:kworker.0 00000100:00100000:1.0:1787784805.691469:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf698b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17693f43-cfcf-4d1e-8495-73723b171a31:3295:1874627643188096:0@lo:400:kworker.0 00000100:00100000:1.0:1787784805.691480:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf69b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643188608:0@lo:400:kworker.0 00000100:00100000:1.0:1787784805.691490:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf69b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643188480:0@lo:400:kworker.0 00000020:00000080:3.0:1787784805.729498:0:21077:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa64e0010 20000000:00000080:3.0:1787784805.729540:0:21077:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff943081dbd400 uarg=0000000000000000 20000000:01000000:3.0:1787784805.729587:0:21077:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787784805.729595:0:21077:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787784805.729602:0:21077:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787784805.734534:0:21078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1787784805.735174:0:21077:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787784805.747314:0:21077:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787784805.747554:0:21077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9431be794200/0xffb8d925c20bc4e7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784805.747580:0:21077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431bf7f0800/0xffb8d925c20bc1a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc19f expref: 18 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784805.747603:0:21077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943181512800/0xffb8d925c20bc1f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc1ec expref: 18 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784805.747611:0:21077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431bf500a00/0xffb8d925c20bc343 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc33c expref: 18 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784805.747622:0:21077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431bee88a00/0xffb8d925c20bc485 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aefa expref: 12 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784805.747629:0:21077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431829d0000/0xffb8d925c20bc4bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849af5c expref: 12 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784805.747637:0:21077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9431be794200/0xffb8d925c20bc4e7 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784805.747696:0:21077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431829d0000/0xffb8d925c20bc4bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849af5c expref: 12 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784805.747715:0:21077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9431829d0000/0xffb8d925c20bc4bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849af5c expref: 12 pid: 18954 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784805.747735:0:21077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf69a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21077:1874627643188736:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784805.747864:0:21077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431bee88a00/0xffb8d925c20bc485 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849aefa expref: 12 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784805.747872:0:21077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9431bee88a00/0xffb8d925c20bc485 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aefa expref: 12 pid: 18952 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784805.747882:0:21077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf699680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21077:1874627643188864:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784805.747923:0:21077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431bf500a00/0xffb8d925c20bc343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20bc33c expref: 18 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784805.747931:0:21077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9431bf500a00/0xffb8d925c20bc343 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20bc33c expref: 18 pid: 18954 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784805.747940:0:21077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf698f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21077:1874627643188992:0@lo:104: 00000100:00100000:2.0:1787784805.747990:0:21077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787784805.748046:0:21077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943181512800/0xffb8d925c20bc1f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20bc1ec expref: 18 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784805.748055:0:21077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff943181512800/0xffb8d925c20bc1f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20bc1ec expref: 18 pid: 18954 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784805.748064:0:21077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf69b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21077:1874627643189120:0@lo:104: 00000100:00100000:2.0:1787784805.748086:0:21077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787784805.748107:0:21077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431bf7f0800/0xffb8d925c20bc1a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20bc19f expref: 18 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784805.748115:0:21077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9431bf7f0800/0xffb8d925c20bc1a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20bc19f expref: 18 pid: 18953 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784805.748124:0:21077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf698b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21077:1874627643189248:0@lo:104: 00000100:00100000:2.0:1787784805.748151:0:21077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784805.748161:0:21077:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431833d40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784805.748314:0:18942:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787784805.748338:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643188992 00000100:00100000:1.0:1787784805.748347:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643188992 00000100:00100000:1.0:1787784805.748440:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643189120 00000100:00100000:1.0:1787784805.748444:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643189120 00000100:00100000:1.0:1787784805.748455:0:18942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643189248 00000100:00100000:1.0:1787784805.748458:0:18942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643189248 00000100:00100000:1.0:1787784805.748472:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787784805.748483:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17693f43-cfcf-4d1e-8495-73723b171a31+5:21077:x1874627643188992:12345-0@lo:104: 00010000:00010000:1.0:1787784805.748500:0:18942:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff9431be795800/0xffb8d925c20bc33c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bc343 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.748579:0:18942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787784805.748585:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17693f43-cfcf-4d1e-8495-73723b171a31+5:21077:x1874627643188992:12345-0@lo:104: Request processed in 105us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784805.748594:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787784805.748615:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784805.748621:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17693f43-cfcf-4d1e-8495-73723b171a31+4:21077:x1874627643189120:12345-0@lo:104: 00010000:00010000:1.0:1787784805.748629:0:18942:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff9431bee88000/0xffb8d925c20bc1ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bc1f3 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.748680:0:18942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787784805.748685:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17693f43-cfcf-4d1e-8495-73723b171a31+4:21077:x1874627643189120:12345-0@lo:104: Request processed in 65us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784805.748692:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784805.748704:0:18942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787784805.748710:0:18942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba102450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17693f43-cfcf-4d1e-8495-73723b171a31+3:21077:x1874627643189248:12345-0@lo:104: 00010000:00010000:1.0:1787784805.748718:0:18942:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bc19f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bc1a6 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.748749:0:18942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787784805.748754:0:18942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba102450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17693f43-cfcf-4d1e-8495-73723b171a31+3:21077:x1874627643189248:12345-0@lo:104: Request processed in 45us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784805.748760:0:18942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787784805.748802:0:20630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787784805.748809:0:20630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431be795800/0xffb8d925c20bc33c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bc343 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.748817:0:20630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431be795800 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:1.0:1787784805.748823:0:20630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431be795800/0xffb8d925c20bc33c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20bc343 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.748833:0:20630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431be795800/0xffb8d925c20bc33c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20bc343 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784805.748841:0:20630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431be795800/0xffb8d925c20bc33c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20bc343 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784805.748848:0:20630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787784805.748893:0:20630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431be795800/0xffb8d925c20bc33c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bc343 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.748900:0:20630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784805.748925:0:20630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431be795800/0xffb8d925c20bc33c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bc343 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.748933:0:20630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431be795800/0xffb8d925c20bc33c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bc343 expref: -99 pid: 20366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.748949:0:20630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784805.748952:0:20630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431bee88000/0xffb8d925c20bc1ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bc1f3 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.748958:0:20630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88000 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:1.0:1787784805.748961:0:20630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431bee88000/0xffb8d925c20bc1ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20bc1f3 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.748968:0:20630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431bee88000/0xffb8d925c20bc1ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20bc1f3 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784805.748975:0:20630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431bee88000/0xffb8d925c20bc1ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20bc1f3 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784805.748980:0:20630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787784805.748993:0:20630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431bee88000/0xffb8d925c20bc1ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bc1f3 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.748998:0:20630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784805.749004:0:20630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431bee88000/0xffb8d925c20bc1ec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bc1f3 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.749022:0:20630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431bee88000/0xffb8d925c20bc1ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bc1f3 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.749033:0:20630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784805.749036:0:20630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bc19f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bc1a6 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.749042:0:20630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88800 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:1.0:1787784805.749045:0:20630:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bc19f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20bc1a6 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.749052:0:20630:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bc19f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20bc1a6 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784805.749059:0:20630:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bc19f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20bc1a6 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784805.749065:0:20630:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787784805.749079:0:20630:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bc19f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bc1a6 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.749084:0:20630:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784805.749101:0:20630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bc19f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bc1a6 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.749108:0:20630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bc19f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bc1a6 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.749122:0:20630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784805.749130:0:20630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784805.749131:0:20630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784805.749139:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784805.749163:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189163c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17693f43-cfcf-4d1e-8495-73723b171a31:3293:1874627643189376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784805.749199:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784805.749229:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784805.749235:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189161680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17693f43-cfcf-4d1e-8495-73723b171a31:3293:1874627643189504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784805.749255:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784805.749286:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431891621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17693f43-cfcf-4d1e-8495-73723b171a31:3295:1874627643189632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784805.749313:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784805.749354:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643189376 00000100:00100000:1.0:1787784805.749358:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643189376 00010000:00010000:1.0:1787784805.749407:0:18945:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431bf500a00/0xffb8d925c20bc343 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bc33c expref: 19 pid: 18954 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784805.749424:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643189504 00000100:00100000:1.0:1787784805.749426:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643189504 00010000:00010000:1.0:1787784805.749437:0:18945:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943181512800/0xffb8d925c20bc1f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bc1ec expref: 20 pid: 18954 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784805.749446:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643189632 00000100:00100000:1.0:1787784805.749448:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643189632 00010000:00010000:1.0:1787784805.749457:0:18945:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431bf7f0800/0xffb8d925c20bc1a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bc19f expref: 21 pid: 18953 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784805.749468:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787784805.749474:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431891603c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17693f43-cfcf-4d1e-8495-73723b171a31+21:3293:x1874627643189376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787784805.749486:0:18945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784805.749492:0:18945:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431bf500a00/0xffb8d925c20bc343 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bc33c expref: 21 pid: 18954 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.749535:0:18945:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431bf500a00/0xffb8d925c20bc343 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20bc33c expref: 21 pid: 18954 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.749555:0:18945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784805.749587:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431891603c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17693f43-cfcf-4d1e-8495-73723b171a31+21:3293:x1874627643189376:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784805.749594:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787784805.749609:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784805.749615:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17693f43-cfcf-4d1e-8495-73723b171a31+20:3293:x1874627643189504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787784805.749623:0:18945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784805.749627:0:18945:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943181512800/0xffb8d925c20bc1f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bc1ec expref: 20 pid: 18954 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.749636:0:18945:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943181512800/0xffb8d925c20bc1f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20bc1ec expref: 20 pid: 18954 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.749645:0:18945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784805.749665:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17693f43-cfcf-4d1e-8495-73723b171a31+20:3293:x1874627643189504:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784805.749671:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784805.749684:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787784805.749690:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9536450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17693f43-cfcf-4d1e-8495-73723b171a31+19:3295:x1874627643189632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787784805.749697:0:18945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784805.749701:0:18945:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431bf7f0800/0xffb8d925c20bc1a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bc19f expref: 19 pid: 18953 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.749709:0:18945:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431bf7f0800/0xffb8d925c20bc1a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20bc19f expref: 19 pid: 18953 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.749726:0:18945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784805.749753:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9536450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17693f43-cfcf-4d1e-8495-73723b171a31+19:3295:x1874627643189632:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784805.749760:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787784805.749845:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431891621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17693f43-cfcf-4d1e-8495-73723b171a31:3295:1874627643189632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784805.749886:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189161680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17693f43-cfcf-4d1e-8495-73723b171a31:3293:1874627643189504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784805.749893:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189163c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17693f43-cfcf-4d1e-8495-73723b171a31:3293:1874627643189376:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784805.749994:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784805.750709:0:21077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf500a00/0xffb8d925c20bc343 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20bc33c expref: 18 pid: 18954 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784805.750723:0:21077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf698f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21077:1874627643188992:0@lo:104: 00010000:00010000:2.0:1787784805.750742:0:21077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943181512800/0xffb8d925c20bc1f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20bc1ec expref: 17 pid: 18954 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784805.750762:0:21077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf69b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21077:1874627643189120:0@lo:104: 00010000:00010000:2.0:1787784805.750778:0:21077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf7f0800/0xffb8d925c20bc1a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20bc19f expref: 16 pid: 18953 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784805.750786:0:21077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf698b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21077:1874627643189248:0@lo:104: 00000100:00100000:3.0:1787784805.752639:0:21077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf69a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21077:1874627643188736:192.168.202.59@tcp:104: 00000100:00100000:3.0:1787784805.752659:0:21077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf699680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21077:1874627643188864:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784805.752705:0:21077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9431be794200/0xffb8d925c20bc4e7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784805.762918:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784805.763042:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784805.763135:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634802304 00000100:00100000:1.0:1787784805.763149:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634802304 00010000:00010000:1.0:1787784805.763201:0:18945:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431bee88a00/0xffb8d925c20bc485 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aefa expref: 13 pid: 18952 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784805.763247:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634802176 00000100:00100000:1.0:1787784805.763250:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634802176 00010000:00010000:1.0:1787784805.763263:0:18945:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431829d0000/0xffb8d925c20bc4bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849af5c expref: 14 pid: 18954 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784805.763278:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:1.0:1787784805.763288:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197115e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3c44031-71ab-414a-bb9a-73f59e219c51+14:2363:x1874627634802304:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784805.763308:0:18945:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784805.763315:0:18945:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431bee88a00/0xffb8d925c20bc485 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aefa expref: 14 pid: 18952 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.763327:0:18945:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431bee88a00/0xffb8d925c20bc485 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aefa expref: 14 pid: 18952 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784805.763396:0:18944:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1787784805.763400:0:18945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bee88a00/0xffb8d925c20bc485 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aefa expref: 14 pid: 18952 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784805.763408:0:18944:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1787784805.763423:0:18945:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784805.763609:0:18946:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787784805.763624:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:0.0:1787784805.763633:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197114780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3c44031-71ab-414a-bb9a-73f59e219c51+13:2363:x1874627634802176:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784805.763642:0:18946:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784805.763647:0:18946:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431829d0000/0xffb8d925c20bc4bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849af5c expref: 13 pid: 18954 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784805.763658:0:18946:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431829d0000/0xffb8d925c20bc4bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849af5c expref: 13 pid: 18954 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784805.763668:0:18946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431829d0000/0xffb8d925c20bc4bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849af5c expref: 13 pid: 18954 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784805.763684:0:18946:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9431be794200/0xffb8d925c20bc4e7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784805.763705:0:18946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431be794200/0xffb8d925c20bc4e7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784805.763723:0:18946:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9431be794200/0xffb8d925c20bc4e7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784805.763731:0:18946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9431be794200/0xffb8d925c20bc4e7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784805.763740:0:18946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9431be794200/0xffb8d925c20bc4e7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784805.763747:0:18946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9431be794200/0xffb8d925c20bc4e7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784805.763754:0:18946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431be794200 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784805.763759:0:18946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9431be794200/0xffb8d925c20bc4e7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784805.763767:0:18946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9431be794200/0xffb8d925c20bc4e7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784805.763794:0:18946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9431be794200/0xffb8d925c20bc4e7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784805.763807:0:18946:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784805.763845:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197114780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3c44031-71ab-414a-bb9a-73f59e219c51+12:2363:x1874627634802176:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 214us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784805.763854:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:1.0:1787784805.764167:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197115e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b3c44031-71ab-414a-bb9a-73f59e219c51+11:2363:x1874627634802304:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 878us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784805.764176:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00010000:00010000:2.0:1787784805.764436:0:21077:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9431be794200/0xffb8d925c20bc4e7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784805.764447:0:21077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9431be794200/0xffb8d925c20bc4e7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784805.764454:0:21077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431be794200/0xffb8d925c20bc4e7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784805.876640:0:20630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787784806.453179:0:18992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787784806.900955:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784807.545066:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784807.547776:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634802432 00000100:00100000:1.0:1787784807.547800:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634802432 00000100:00100000:1.0:1787784807.547902:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 107 00000100:00100000:1.0:1787784807.547915:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+11:16790:x1874627634802432:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784807.547940:0:18952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784807.547969:0:18952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431829d1000/0xffb8d925c20bc4ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849af8d expref: -99 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784807.548007:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431829d1000/0xffb8d925c20bc4ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849af8d expref: 12 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784807.548021:0:18952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431829d1000/0xffb8d925c20bc4ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849af8d expref: 12 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784807.548032:0:18952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1000, rc 0) 00000100:00100000:1.0:1787784807.548124:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+12:16790:x1874627634802432:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 Request processed in 211us (3085us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784807.548132:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 107 00000100:00100000:3.0:1787784807.565572:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784807.567607:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634802560 00000100:00100000:2.0:1787784807.567631:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634802560 00000100:00100000:2.0:1787784807.567727:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 108 00000100:00100000:2.0:1787784807.567740:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3c44031-71ab-414a-bb9a-73f59e219c51+12:16790:x1874627634802560:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784807.568186:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3c44031-71ab-414a-bb9a-73f59e219c51+12:16790:x1874627634802560:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 Request processed in 447us (2626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784807.568195:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 108 00000100:00100000:0.0:1787784807.572659:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784807.573873:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634802688 00000100:00100000:2.0:1787784807.573891:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634802688 00000100:00100000:2.0:1787784807.574081:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 109 00000100:00100000:2.0:1787784807.574098:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+12:16790:x1874627634802688:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784807.574778:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+12:16790:x1874627634802688:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 Request processed in 679us (2130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784807.574789:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 109 00000100:00100000:3.0:1787784807.591454:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784807.591718:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634802816 00000100:00100000:1.0:1787784807.591749:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634802816 00000100:00100000:1.0:1787784807.591812:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 110 00000100:00100000:1.0:1787784807.591824:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+12:16790:x1874627634802816:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784807.591848:0:18952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784807.591873:0:18952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431829d1a00/0xffb8d925c20bc4f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849af94 expref: -99 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784807.591913:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431829d1a00/0xffb8d925c20bc4f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849af94 expref: 13 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784807.591926:0:18952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431829d1a00/0xffb8d925c20bc4f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849af94 expref: 13 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784807.591936:0:18952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1a00, rc 0) 00000100:00100000:1.0:1787784807.592030:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+13:16790:x1874627634802816:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 Request processed in 208us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784807.592047:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 110 00000100:00100000:3.0:1787784807.597776:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784807.598707:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634802944 00000100:00100000:2.0:1787784807.598723:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634802944 00000100:00100000:2.0:1787784807.598813:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 111 00000100:00100000:2.0:1787784807.598827:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+13:16790:x1874627634802944:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784807.599249:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+13:16790:x1874627634802944:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 Request processed in 424us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784807.599258:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 111 00000100:00100000:3.0:1787784807.608520:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784807.608664:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634803072 00000100:00100000:0.0:1787784807.608678:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634803072 00000100:00100000:0.0:1787784807.608753:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 112 00000100:00100000:0.0:1787784807.608777:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3c44031-71ab-414a-bb9a-73f59e219c51+13:16790:x1874627634803072:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784807.609744:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3c44031-71ab-414a-bb9a-73f59e219c51+13:16790:x1874627634803072:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 Request processed in 970us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784807.609758:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 112 10000000:01000000:1.0:1787784807.668855:0:18956:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787784807.668867:0:18956:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9431be3c4800 from 10 10000000:01000000:1.0:1787784807.668875:0:18956:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787784807.669468:0:18956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0800/0xffb8d925c20bc4fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784807.669494:0:18956:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431829d0800/0xffb8d925c20bc4fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784807.669510:0:18956:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431829d0800/0xffb8d925c20bc4fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784807.669545:0:18956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643189760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787784807.670240:0:18956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784807.670460:0:18956:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186893cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784807.671926:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643189760 00000100:00100000:0.0:1787784807.671946:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643189760 00000100:00100000:0.0:1787784807.672065:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787784807.672079:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+16:18956:x1874627643189760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784807.672104:0:18952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784807.672131:0:18952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bee89e00/0xffb8d925c20bc503 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bc4fc expref: -99 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784807.672166:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bee89e00/0xffb8d925c20bc503 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bc4fc expref: 17 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784807.672181:0:18952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bee89e00/0xffb8d925c20bc503 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc4fc expref: 17 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784807.672192:0:18952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89e00, rc 0) 00000100:00100000:0.0:1787784807.672307:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+17:18956:x1874627643189760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 231us (2071us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784807.672317:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787784807.672644:0:18956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643189760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784807.672669:0:18956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431829d0800/0xffb8d925c20bc4fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc503 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784807.672679:0:18956:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431829d0800/0xffb8d925c20bc4fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bc503 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784807.672768:0:18956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643189888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784807.672811:0:18956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784807.672913:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643189888 00000100:00100000:2.0:1787784807.672918:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643189888 00000100:00100000:2.0:1787784807.672957:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787784807.672965:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+17:18956:x1874627643189888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784807.673317:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+17:18956:x1874627643189888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 351us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784807.673325:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787784807.676639:0:18956:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186893cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784807.676709:0:18956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643189888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784807.676817:0:18956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643190016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784807.676927:0:18956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784807.677321:0:18956:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186893cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784807.681289:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643190016 00000100:00100000:0.0:1787784807.681313:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643190016 00000100:00100000:0.0:1787784807.681426:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787784807.681458:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+17:18956:x1874627643190016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784807.681824:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+17:18956:x1874627643190016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 368us (4896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784807.681833:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787784807.682310:0:18956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643190016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787784807.683570:0:21092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787784807.684225:0:18956:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787784807.684252:0:18956:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787784807.684267:0:18956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0800/0xffb8d925c20bc4fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc503 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.684305:0:18956:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431829d0800/0xffb8d925c20bc4fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc503 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784807.684317:0:18956:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787784807.684321:0:18956:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9431900a1800 from 10 10000000:01000000:2.0:1787784807.684324:0:18956:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787784807.684411:0:18956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431be794200/0xffb8d925c20bc50a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.684419:0:18956:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431be794200/0xffb8d925c20bc50a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.684430:0:18956:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431be794200/0xffb8d925c20bc50a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784807.684462:0:18956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf6983c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643190144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787784807.684633:0:18956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784807.684692:0:18956:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431833d4900 going to sleep for 11 seconds 00000100:00100000:3.0:1787784807.684785:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643190144 00000100:00100000:3.0:1787784807.684794:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643190144 00000100:00100000:3.0:1787784807.684850:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787784807.684860:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b39a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+17:18956:x1874627643190144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784807.684875:0:18954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784807.684890:0:18954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf500800/0xffb8d925c20bc511 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bc50a expref: -99 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784807.684918:0:18954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf500800/0xffb8d925c20bc511 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bc50a expref: 18 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784807.684940:0:18954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf500800/0xffb8d925c20bc511 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc50a expref: 18 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784807.684963:0:18954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500800, rc 0) 00000100:00100000:3.0:1787784807.685017:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b39a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+18:18956:x1874627643190144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784807.685025:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787784807.685212:0:18956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf6983c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643190144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784807.685229:0:18956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431be794200/0xffb8d925c20bc50a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc511 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.685239:0:18956:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431be794200/0xffb8d925c20bc50a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bc511 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784807.685302:0:18956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf6983c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643190272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784807.685331:0:18956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784807.685387:0:18956:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431833d4900 going to sleep for 11 seconds 00000100:00100000:3.0:1787784807.685467:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643190272 00000100:00100000:3.0:1787784807.685472:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643190272 00000100:00100000:3.0:1787784807.685499:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787784807.685506:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430826c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+18:18956:x1874627643190272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784807.686810:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430826c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+18:18956:x1874627643190272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1296us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784807.686823:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787784807.686939:0:18956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf6983c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643190272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784807.687004:0:18956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf6983c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643190400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784807.687189:0:18956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784807.687228:0:18956:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431833d4900 going to sleep for 11 seconds 00000100:00100000:0.0:1787784807.687291:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643190400 00000100:00100000:0.0:1787784807.687299:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643190400 00000100:00100000:0.0:1787784807.687346:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787784807.687357:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430826c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+18:18956:x1874627643190400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784807.687603:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430826c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+18:18956:x1874627643190400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 248us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784807.687612:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787784807.687708:0:18956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf6983c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643190400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787784807.695700:0:21093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787784807.700869:0:18956:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787784807.700922:0:18956:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787784807.700938:0:18956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431be794200/0xffb8d925c20bc50a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc511 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.700966:0:18956:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431be794200/0xffb8d925c20bc50a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc511 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784807.700980:0:18956:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787784807.700984:0:18956:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9430827c4800 from 10 10000000:01000000:2.0:1787784807.700987:0:18956:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787784807.701060:0:18956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431be795a00/0xffb8d925c20bc518 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.701069:0:18956:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431be795a00/0xffb8d925c20bc518 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.701084:0:18956:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431be795a00/0xffb8d925c20bc518 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784807.701118:0:18956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf6983c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643190528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787784807.701215:0:18956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784807.701300:0:18956:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431833d4900 going to sleep for 11 seconds 00000100:00100000:3.0:1787784807.701549:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643190528 00000100:00100000:3.0:1787784807.701558:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643190528 00000100:00100000:3.0:1787784807.701629:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787784807.701641:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430826c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+18:18956:x1874627643190528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784807.701658:0:18954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784807.701673:0:18954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf501600/0xffb8d925c20bc51f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bc518 expref: -99 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784807.701701:0:18954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf501600/0xffb8d925c20bc51f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bc518 expref: 19 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784807.701712:0:18954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf501600/0xffb8d925c20bc51f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bc518 expref: 19 pid: 18954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784807.701733:0:18954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501600, rc 0) 00000100:00100000:3.0:1787784807.701787:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430826c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17693f43-cfcf-4d1e-8495-73723b171a31+19:18956:x1874627643190528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784807.701795:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787784807.701855:0:18956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf6983c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643190528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784807.701872:0:18956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431be795a00/0xffb8d925c20bc518 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc51f expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784807.701882:0:18956:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431be795a00/0xffb8d925c20bc518 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bc51f expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784807.701941:0:18956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197115a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643190656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784807.701967:0:18956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784807.701985:0:18956:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bee8d540 going to sleep for 11 seconds 00000100:00100000:1.0:1787784807.702071:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643190656 00000100:00100000:1.0:1787784807.702076:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643190656 00000100:00100000:1.0:1787784807.702113:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787784807.702120:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430826c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+19:18956:x1874627643190656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784807.702495:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430826c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+19:18956:x1874627643190656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 364us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784807.702504:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787784807.703090:0:18956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197115a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643190656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784807.703142:0:18956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197115a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643190784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784807.703199:0:18956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784807.703240:0:18956:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bee8d540 going to sleep for 11 seconds 00000100:00100000:1.0:1787784807.703451:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643190784 00000100:00100000:1.0:1787784807.703465:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643190784 00000100:00100000:1.0:1787784807.703511:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787784807.703520:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430826c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+19:18956:x1874627643190784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784807.703744:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430826c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17693f43-cfcf-4d1e-8495-73723b171a31+19:18956:x1874627643190784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 225us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784807.703752:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787784807.703895:0:18956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197115a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17693f43-cfcf-4d1e-8495-73723b171a31:18956:1874627643190784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787784807.705195:0:21094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787784807.712828:0:18956:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787784807.712894:0:18956:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787784807.712912:0:18956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431be795a00/0xffb8d925c20bc518 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc51f expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784807.712929:0:18956:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431be795a00/0xffb8d925c20bc518 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bc51f expref: -99 pid: 18956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784807.754458:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784807.755981:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634803200 00000100:00100000:2.0:1787784807.756002:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634803200 00000100:00100000:2.0:1787784807.756148:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:2.0:1787784807.756164:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197115a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+6:17397:x1874627634803200:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784807.756195:0:19667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784807.756225:0:19667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794400/0xffb8d925c20bc526 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849af9b expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.756323:0:19667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc52d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.756342:0:19667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc52d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.756358:0:19667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc52d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.756398:0:19667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794600/0xffb8d925c20bc534 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.756407:0:19667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794600/0xffb8d925c20bc534 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.756413:0:19667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794600/0xffb8d925c20bc534 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.756967:0:19667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795c00/0xffb8d925c20bc53b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.756978:0:19667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795c00/0xffb8d925c20bc53b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.756998:0:19667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795c00/0xffb8d925c20bc53b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784807.757098:0:19667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787784807.757103:0:19667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787784807.757218:0:19667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795c00/0xffb8d925c20bc53b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.757234:0:19667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc52d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.757241:0:19667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc52d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.757249:0:19667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc52d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.757257:0:19667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431be794000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784807.757262:0:19667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc52d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.757272:0:19667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc52d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.757289:0:19667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9431861c2800) 00010000:00010000:2.0:1787784807.757293:0:19667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784807.757300:0:19667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc52d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.757308:0:19667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc52d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.757335:0:19667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794600/0xffb8d925c20bc534 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.757341:0:19667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794600/0xffb8d925c20bc534 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.757348:0:19667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794600/0xffb8d925c20bc534 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.757353:0:19667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431be794600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784807.757356:0:19667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794600/0xffb8d925c20bc534 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.757362:0:19667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794600/0xffb8d925c20bc534 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.757443:0:19667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9431861c2500) 00010000:00010000:2.0:1787784807.757445:0:19667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784807.757449:0:19667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794600/0xffb8d925c20bc534 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.757455:0:19667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794600/0xffb8d925c20bc534 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.757513:0:19667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794400/0xffb8d925c20bc526 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849af9b expref: 8 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.757529:0:19667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795c00/0xffb8d925c20bc53b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849af9b expref: 7 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.757547:0:19667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9431861c2700) 00010000:00010000:2.0:1787784807.757550:0:19667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787784807.757552:0:19667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431be795c00, rc 0) 00000100:00100000:2.0:1787784807.757645:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197115a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+7:17397:x1874627634803200:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 1485us (3204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784807.757655:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00080000:0.0:1787784807.758155:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784807.765245:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784807.765353:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634803456 00000100:00100000:2.0:1787784807.765407:0:18961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634803456 00000100:00100000:2.0:1787784807.765496:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:2.0:1787784807.765510:0:18961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+7:17397:x1874627634803456:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784807.765540:0:18961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784807.765568:0:18961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc542 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849afa2 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.765676:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc549 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.765694:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc549 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.765708:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc549 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.765725:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc550 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.765732:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc550 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.765756:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc550 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.766359:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794800/0xffb8d925c20bc557 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.766415:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794800/0xffb8d925c20bc557 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.766424:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794800/0xffb8d925c20bc557 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784807.766437:0:18961:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787784807.766747:0:18961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc549 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.766756:0:18961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc549 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.766765:0:18961:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc549 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.766772:0:18961:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431be795400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784807.766777:0:18961:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc549 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.766786:0:18961:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc549 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.766801:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9431861c2700) 00010000:00010000:2.0:1787784807.766804:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784807.766817:0:18961:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc549 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.766825:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc549 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.766840:0:18961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc550 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.766846:0:18961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc550 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.766853:0:18961:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc550 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.766859:0:18961:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431be795000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784807.766862:0:18961:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc550 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.766868:0:18961:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc550 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.766876:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9431861c2e00) 00010000:00010000:2.0:1787784807.766878:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784807.766881:0:18961:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc550 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.766888:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc550 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.767326:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc542 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afa2 expref: 10 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.767360:0:18961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794800/0xffb8d925c20bc557 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afa2 expref: 9 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.767404:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9431861c2b00) 00010000:00010000:2.0:1787784807.767407:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784807.767409:0:18961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431be794800, rc 0) 00000100:00100000:2.0:1787784807.767516:0:18961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+9:17397:x1874627634803456:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 2007us (2287us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1787784807.767526:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:3.0:1787784807.782650:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784807.782769:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634803584 00000100:00100000:2.0:1787784807.782788:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634803584 00000100:00100000:2.0:1787784807.782882:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:2.0:1787784807.782897:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431971143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+9:17397:x1874627634803584:12345-192.168.202.59@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787784807.783093:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431971143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+9:17397:x1874627634803584:12345-192.168.202.59@tcp:59:lhsmtool_posix.0 Request processed in 199us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784807.783103:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:0.0:1787784807.842742:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784807.842922:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634803712 00000100:00100000:2.0:1787784807.842939:0:18961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634803712 00000100:00100000:2.0:1787784807.843025:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:2.0:1787784807.843034:0:18961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+9:17403:x1874627634803712:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784807.843066:0:18961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784807.843100:0:18961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc565 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849afa9 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.843184:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc56c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.843215:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc56c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.843226:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc56c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.843240:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc573 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.843245:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc573 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.843249:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc573 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.844315:0:18961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc56c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.846778:0:18961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc56c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.846791:0:18961:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc56c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.846799:0:18961:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431be795000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784807.846806:0:18961:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc56c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.846817:0:18961:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc56c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.846838:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9431861c2800) 00010000:00010000:2.0:1787784807.846859:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784807.846865:0:18961:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc56c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.846871:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc56c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.846891:0:18961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc573 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.846895:0:18961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc573 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.846899:0:18961:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc573 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.846902:0:18961:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431be795400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784807.846904:0:18961:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc573 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.846907:0:18961:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc573 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.846911:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9431861c2e00) 00010000:00010000:2.0:1787784807.846912:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784807.846914:0:18961:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc573 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.846917:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc573 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.848805:0:18961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc565 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afa9 expref: 10 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.848851:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9431861c2800) 00010000:00010000:2.0:1787784807.848855:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784807.848861:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc565 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afa9 expref: 10 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.848881:0:18961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431be794000, rc 0) 00000100:00100000:2.0:1787784807.850642:0:18961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+9:17403:x1874627634803712:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 7586us (7889us total) trans 0 rc 301/301 00000100:00100000:2.0:1787784807.850660:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:3.0:1787784807.862470:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784807.863710:0:18968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634803840 00000100:00100000:1.0:1787784807.863731:0:18968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634803840 00000100:00100000:1.0:1787784807.863818:0:18968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:1.0:1787784807.863830:0:18968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197115680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+9:17403:x1874627634803840:12345-192.168.202.59@tcp:700:lfs.0 00000100:00100000:1.0:1787784807.863964:0:18968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197115680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+9:17403:x1874627634803840:12345-192.168.202.59@tcp:700:lfs.0 Request processed in 136us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784807.863973:0:18968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:3.0:1787784807.869594:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784807.873114:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634804096 00000100:00100000:2.0:1787784807.873140:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634804096 00000100:00100000:0.0:1787784807.873613:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:0.0:1787784807.873630:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197116940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+9:17403:x1874627634804096:12345-192.168.202.59@tcp:36:lfs.0 00010000:00010000:0.0:1787784807.873715:0:18959:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784807.873753:0:18959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794a00/0xffb8d925c20bc4a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849af24 expref: 9 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784807.873804:0:18959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9431861c2800) 00010000:00010000:0.0:1787784807.873811:0:18959:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787784807.874562:0:18959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bc57a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784807.874583:0:18959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bc4e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849af86 expref: 5 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784807.874606:0:18959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bc57a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784807.874653:0:18959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bc4e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849af86 expref: 5 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784807.874672:0:18959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bc4e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849af86 expref: 5 pid: 19667 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784807.874689:0:18959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45af0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18959:1874627643190912:192.168.202.59@tcp:104: 00000100:00100000:0.0:1787784807.874835:0:18959:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318613d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787784807.879824:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784807.879864:0:18959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45af0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18959:1874627643190912:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784807.879910:0:18959:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bc57a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784807.880007:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634804224 00000100:00100000:2.0:1787784807.880017:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634804224 00010000:00010000:2.0:1787784807.880169:0:18946:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bc4e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849af86 expref: 6 pid: 19667 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784807.880211:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:2.0:1787784807.880222:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ad680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bc1394c-7442-4c5c-9873-3edd9faa1a10+6:2363:x1874627634804224:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784807.880245:0:18946:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784807.880253:0:18946:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bc4e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849af86 expref: 6 pid: 19667 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.880267:0:18946:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bc4e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849af86 expref: 6 pid: 19667 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.880308:0:18946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bc4e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849af86 expref: 6 pid: 19667 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.880359:0:18946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9431861c2800) 00010000:00010000:2.0:1787784807.880397:0:18946:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bc57a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.880412:0:18946:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bc57a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.880421:0:18946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bc57a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784807.880457:0:18946:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784807.880548:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ad680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bc1394c-7442-4c5c-9873-3edd9faa1a10+5:2363:x1874627634804224:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 327us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784807.880557:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00080000:0.0:1787784807.880884:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787784807.882883:0:18959:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bc57a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784807.882905:0:18959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bc57a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784807.882951:0:18959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc581 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784807.882967:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc581 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784807.882980:0:18959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc581 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784807.892136:0:18959:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787784807.892166:0:18959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bc57a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784807.892179:0:18959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bc57a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784807.892188:0:18959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bc57a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784807.892195:0:18959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784807.892201:0:18959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bc57a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784807.892229:0:18959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bc57a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784807.892260:0:18959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9431861c2800) 00010000:00010000:3.0:1787784807.892263:0:18959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784807.892269:0:18959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bc57a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784807.892276:0:18959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bc57a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787784807.892319:0:18959:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b5f0ed2 reply state 000000006588fc4f transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc581 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784807.892332:0:18959:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787784807.892751:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197116940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+10:17403:x1874627634804096:12345-192.168.202.59@tcp:36:lfs.0 Request processed in 19109us (23156us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1787784807.892763:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 19 00010000:00010000:1.0:1787784807.895508:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc581 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784807.895531:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc581 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784807.895540:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc581 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784807.895546:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784807.895551:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc581 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784807.895561:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc581 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784807.895702:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff94319746e100) 00010000:00010000:1.0:1787784807.895706:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784807.895713:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc581 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784807.895720:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc581 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784807.925641:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784808.012588:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784808.012878:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634804352 00000100:00100000:3.0:1787784808.012891:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634804352 00000100:00100000:3.0:1787784808.012968:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:3.0:1787784808.012981:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+9:17411:x1874627634804352:12345-192.168.202.59@tcp:101:lctl.0 00010000:00010000:3.0:1787784808.013015:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784808.013060:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc588 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849afb0 expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.013155:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bc58f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.013192:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bc58f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.013205:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bc58f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784808.013293:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787784808.013298:0:18960:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:3.0:1787784808.013351:0:18960:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bc58f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.013428:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc588 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afb0 expref: 11 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.013451:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bc58f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afb0 expref: 10 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.013460:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94319746ed00) 00010000:00010000:3.0:1787784808.013463:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787784808.013467:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500a00, rc 0) 00000100:00100000:3.0:1787784808.013555:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+10:17411:x1874627634804352:12345-192.168.202.59@tcp:101:lctl.0 Request processed in 577us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784808.013563:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:3.0:1787784808.044523:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784808.044854:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634804480 00000100:00100000:2.0:1787784808.044869:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634804480 00000100:00100000:2.0:1787784808.044950:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:2.0:1787784808.044963:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431971152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6bc1394c-7442-4c5c-9873-3edd9faa1a10+5:17412:x1874627634804480:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784808.044994:0:19667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784808.045021:0:19667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc596 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849afb7 expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.045110:0:19667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc59d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.045127:0:19667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc59d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.045141:0:19667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc59d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784808.045241:0:19667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787784808.045245:0:19667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:2.0:1787784808.045279:0:19667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc59d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.045312:0:19667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc596 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afb7 expref: 7 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.045349:0:19667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795000/0xffb8d925c20bc59d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afb7 expref: 6 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.045360:0:19667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94319746ed00) 00010000:00010000:2.0:1787784808.045412:0:19667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787784808.045417:0:19667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431be795000, rc 0) 00000100:00100000:2.0:1787784808.045524:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431971152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6bc1394c-7442-4c5c-9873-3edd9faa1a10+6:17412:x1874627634804480:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 563us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784808.045533:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:0.0:1787784808.050906:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784808.053210:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634804608 00000100:00100000:3.0:1787784808.053231:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634804608 00000100:00100000:3.0:1787784808.053335:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:3.0:1787784808.053348:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6bc1394c-7442-4c5c-9873-3edd9faa1a10+6:17412:x1874627634804608:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1787784808.053413:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784808.053442:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc5a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849afbe expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.053845:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501400/0xffb8d925c20bc5ab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.053863:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501400/0xffb8d925c20bc5ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.053877:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501400/0xffb8d925c20bc5ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.053894:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc5b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.053901:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc5b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.053907:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc5b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.054232:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc5b9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.054241:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc5b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.054249:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc5b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784808.054299:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787784808.054312:0:18960:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787784808.054346:0:18960:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc5b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.054361:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501400/0xffb8d925c20bc5ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.054398:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501400/0xffb8d925c20bc5ab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.054406:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501400/0xffb8d925c20bc5ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.054412:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784808.054418:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501400/0xffb8d925c20bc5ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.054426:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501400/0xffb8d925c20bc5ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.054442:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94319746ed00) 00010000:00010000:3.0:1787784808.054445:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784808.054450:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501400/0xffb8d925c20bc5ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.054458:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501400/0xffb8d925c20bc5ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.054843:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc5b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.054850:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc5b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.054869:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc5b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.054875:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784808.054879:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc5b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.054886:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc5b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.054895:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff94319746e300) 00010000:00010000:3.0:1787784808.054898:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784808.054900:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc5b2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.054905:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc5b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.054960:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc5a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afbe expref: 8 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.054975:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc5b9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afbe expref: 7 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.054983:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94319746ea00) 00010000:00010000:3.0:1787784808.054984:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787784808.054987:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500e00, rc 0) 00000100:00100000:3.0:1787784808.055158:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6bc1394c-7442-4c5c-9873-3edd9faa1a10+7:17412:x1874627634804608:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1811us (4271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784808.055177:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:1.0:1787784808.061592:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784808.062524:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634804864 00000100:00100000:2.0:1787784808.062539:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634804864 00000100:00100000:2.0:1787784808.062631:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:2.0:1787784808.062645:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6bc1394c-7442-4c5c-9873-3edd9faa1a10+7:17412:x1874627634804864:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784808.062676:0:19667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784808.062706:0:19667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc5c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849afc5 expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784808.062875:0:19667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787784808.063048:0:19667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc5c0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afc5 expref: 9 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.063086:0:19667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94319746ed00) 00010000:00010000:2.0:1787784808.063090:0:19667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784808.063097:0:19667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc5c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afc5 expref: 9 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.063117:0:19667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431be795400, rc 0) 00000100:00100000:2.0:1787784808.063217:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6bc1394c-7442-4c5c-9873-3edd9faa1a10+8:17412:x1874627634804864:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 575us (1647us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1787784808.063225:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:2.0:1787784808.084725:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784808.084840:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634805120 00000100:00100000:3.0:1787784808.084857:0:18961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634805120 00000100:00100000:3.0:1787784808.084941:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 24 00000100:00100000:3.0:1787784808.084955:0:18961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf699680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6bc1394c-7442-4c5c-9873-3edd9faa1a10+8:17412:x1874627634805120:12345-192.168.202.59@tcp:36:lfs.0 00010000:00010000:3.0:1787784808.085040:0:18961:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784808.085083:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc5b9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afbe expref: 8 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.085112:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94319746ea00) 00010000:00010000:3.0:1787784808.085126:0:18961:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787784808.085162:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc5ce lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.085178:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc5ce lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.085189:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc5ce lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787784808.085814:0:18961:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000669e5f66 reply state 00000000c36c602e transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc5ce lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784808.085829:0:18961:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787784808.085849:0:18961:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1787784808.085972:0:18961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf699680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6bc1394c-7442-4c5c-9873-3edd9faa1a10+9:17412:x1874627634805120:12345-192.168.202.59@tcp:36:lfs.0 Request processed in 1018us (1272us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1787784808.085981:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 24 00000100:00100000:1.0:1787784808.100995:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00010000:00010000:3.0:1787784808.101117:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc5ce lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.101134:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc5ce lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.101144:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc5ce lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.101151:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784808.101156:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc5ce lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.101165:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc5ce lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.101191:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff94319746e300) 00010000:00010000:3.0:1787784808.101194:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787784808.101200:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc5ce lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.101207:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc5ce lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784808.101545:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634805376 00000100:00100000:2.0:1787784808.101560:0:18962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634805376 00000100:00100000:2.0:1787784808.101633:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:2.0:1787784808.101645:0:18962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6bc1394c-7442-4c5c-9873-3edd9faa1a10+8:17412:x1874627634805376:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:2.0:1787784808.102034:0:18962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6bc1394c-7442-4c5c-9873-3edd9faa1a10+9:17412:x1874627634805376:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 390us (1053us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1787784808.102043:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:1.0:1787784808.104800:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784808.105029:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634805632 00000100:00100000:2.0:1787784808.105043:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634805632 00000100:00100000:2.0:1787784808.105123:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 25 00000100:00100000:2.0:1787784808.105135:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6bc1394c-7442-4c5c-9873-3edd9faa1a10+9:17412:x1874627634805632:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784808.105166:0:19667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784808.105195:0:19667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc5d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849afcc expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.105314:0:19667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794600/0xffb8d925c20bc5dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.105332:0:19667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794600/0xffb8d925c20bc5dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.105346:0:19667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794600/0xffb8d925c20bc5dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.105408:0:19667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794400/0xffb8d925c20bc5e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.105416:0:19667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794400/0xffb8d925c20bc5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.105424:0:19667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794400/0xffb8d925c20bc5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784808.105610:0:19667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787784808.105741:0:19667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794600/0xffb8d925c20bc5dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.105750:0:19667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794600/0xffb8d925c20bc5dc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.105758:0:19667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794600/0xffb8d925c20bc5dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.105764:0:19667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431be794600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784808.105769:0:19667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794600/0xffb8d925c20bc5dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.105789:0:19667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794600/0xffb8d925c20bc5dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.105805:0:19667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94319746ed00) 00010000:00010000:2.0:1787784808.105808:0:19667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784808.105814:0:19667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794600/0xffb8d925c20bc5dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.105821:0:19667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794600/0xffb8d925c20bc5dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.105838:0:19667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794400/0xffb8d925c20bc5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.105844:0:19667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794400/0xffb8d925c20bc5e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.105850:0:19667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794400/0xffb8d925c20bc5e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.105856:0:19667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431be794400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784808.105859:0:19667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794400/0xffb8d925c20bc5e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.105866:0:19667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794400/0xffb8d925c20bc5e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.105872:0:19667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9431861c2e00) 00010000:00010000:2.0:1787784808.105875:0:19667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784808.105878:0:19667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794400/0xffb8d925c20bc5e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.105895:0:19667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794400/0xffb8d925c20bc5e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.105945:0:19667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc5d5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afcc expref: 11 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.105956:0:19667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94319746ed00) 00010000:00010000:2.0:1787784808.105958:0:19667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784808.105962:0:19667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795400/0xffb8d925c20bc5d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afcc expref: 11 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.105972:0:19667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431be795400, rc 0) 00000100:00100000:2.0:1787784808.106058:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6bc1394c-7442-4c5c-9873-3edd9faa1a10+10:17412:x1874627634805632:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 925us (1273us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1787784808.106067:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 25 00000100:00100000:3.0:1787784808.114926:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784808.115112:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634805760 00000100:00100000:2.0:1787784808.115125:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634805760 00000100:00100000:2.0:1787784808.115205:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 26 00000100:00100000:2.0:1787784808.115218:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197116d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6bc1394c-7442-4c5c-9873-3edd9faa1a10+10:17412:x1874627634805760:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784808.115253:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784808.115283:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794a00/0xffb8d925c20bc5f1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849afd3 expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.115436:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc5f8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.115456:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc5f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.115512:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc5f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784808.115584:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787784808.115589:0:18960:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787784808.115618:0:18960:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc5f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.115653:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794a00/0xffb8d925c20bc5f1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afd3 expref: 12 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.115675:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc5f8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afd3 expref: 11 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.115685:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9431861c2500) 00010000:00010000:2.0:1787784808.115688:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787784808.115693:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431be794000, rc 0) 00000100:00100000:2.0:1787784808.115768:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197116d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6bc1394c-7442-4c5c-9873-3edd9faa1a10+11:17412:x1874627634805760:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 552us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784808.115776:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 26 00000100:00100000:1.0:1787784808.124543:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784808.124755:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634805888 00000100:00100000:2.0:1787784808.124772:0:18962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634805888 00000100:00100000:2.0:1787784808.124853:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 3 00000100:00100000:2.0:1787784808.124867:0:18962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6bc1394c-7442-4c5c-9873-3edd9faa1a10+11:17412:x1874627634805888:12345-192.168.202.59@tcp:37:lfs.0 00000100:00100000:2.0:1787784808.131154:0:18962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6bc1394c-7442-4c5c-9873-3edd9faa1a10+11:17412:x1874627634805888:12345-192.168.202.59@tcp:37:lfs.0 Request processed in 6272us (6608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784808.131173:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 3 00000100:00100000:3.0:1787784808.154680:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784808.154923:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634806144 00000100:00100000:1.0:1787784808.154937:0:18963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634806144 00000100:00100000:1.0:1787784808.155012:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:1.0:1787784808.155026:0:18963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187677850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6bc1394c-7442-4c5c-9873-3edd9faa1a10+11:17412:x1874627634806144:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:1.0:1787784808.155466:0:18963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187677850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6bc1394c-7442-4c5c-9873-3edd9faa1a10+12:17412:x1874627634806144:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 441us (799us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1787784808.155476:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:1.0:1787784808.184117:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784808.184274:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634806272 00000100:00100000:3.0:1787784808.184287:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634806272 00000100:00100000:3.0:1787784808.184387:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 122 00000100:00100000:3.0:1787784808.184401:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430826c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+13:2363:x1874627634806272:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784808.184518:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430826c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3c44031-71ab-414a-bb9a-73f59e219c51+13:2363:x1874627634806272:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 120us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784808.184545:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 122 00000100:00100000:0.0:1787784808.189856:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784808.189899:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784808.189929:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784808.189970:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784808.190025:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784808.190075:0:19643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634806528 00000100:00100000:0.0:1787784808.190088:0:19643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634806528 00000100:00100000:0.0:1787784808.190153:0:19643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634806784 00000100:00100000:0.0:1787784808.190156:0:19643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634806784 00000100:00100000:0.0:1787784808.190174:0:19643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634806656 00000100:00100000:0.0:1787784808.190176:0:19643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634806656 00000100:00100000:0.0:1787784808.190190:0:19643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634806912 00000100:00100000:0.0:1787784808.190192:0:19643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634806912 00000100:00100000:0.0:1787784808.190212:0:19643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:0.0:1787784808.190224:0:19643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+5:2363:x1874627634806528:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784808.190258:0:20123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:2.0:1787784808.190268:0:20123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6bc1394c-7442-4c5c-9873-3edd9faa1a10+5:2363:x1874627634806784:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784808.190336:0:19646:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787784808.190347:0:19646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1787784808.190538:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:3.0:1787784808.190547:0:19646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+5:2363:x1874627634806656:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784808.190854:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634806400 00000100:00100000:1.0:1787784808.190860:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634806400 00000100:00100000:1.0:1787784808.190910:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:1.0:1787784808.190917:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+10:2363:x1874627634806400:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784808.191011:0:19643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+5:2363:x1874627634806528:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 787us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784808.191021:0:19643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:0.0:1787784808.191054:0:19643:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1787784808.191063:0:19643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:0.0:1787784808.191070:0:19643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6bc1394c-7442-4c5c-9873-3edd9faa1a10+5:2363:x1874627634806912:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784808.198243:0:20123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6bc1394c-7442-4c5c-9873-3edd9faa1a10+5:2363:x1874627634806784:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 7958us (8324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784808.198265:0:20123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00080000:2.0:1787784808.198527:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787784808.198535:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784808.203201:0:19646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+5:2363:x1874627634806656:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 12637us (13212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784808.203223:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:1.0:1787784808.215621:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+10:2363:x1874627634806400:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 24683us (25669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784808.215664:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:0.0:1787784808.215882:0:19643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6bc1394c-7442-4c5c-9873-3edd9faa1a10+5:2363:x1874627634806912:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 24809us (25853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784808.215894:0:19643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:2.0:1787784808.250188:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784808.250494:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634807040 00000100:00100000:3.0:1787784808.250509:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634807040 00000100:00100000:3.0:1787784808.250590:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 27 00000100:00100000:3.0:1787784808.250611:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+10:17418:x1874627634807040:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:3.0:1787784808.250641:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784808.250670:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc5ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849afda expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.250888:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc606 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.250908:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc606 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.250924:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc606 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.250953:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc60d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.250981:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc60d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.250989:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc60d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.251229:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501400/0xffb8d925c20bc614 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.251240:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501400/0xffb8d925c20bc614 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.251247:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501400/0xffb8d925c20bc614 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784808.251287:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787784808.251292:0:18960:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787784808.251350:0:18960:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501400/0xffb8d925c20bc614 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.251429:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc606 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.251437:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc606 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.251444:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc606 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.251450:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500e00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784808.251454:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc606 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.251472:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc606 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.251499:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94319746ed00) 00010000:00010000:3.0:1787784808.251503:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784808.251509:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc606 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.251517:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc606 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.251535:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc60d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.251541:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc60d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.251548:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc60d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.251553:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784808.251556:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc60d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.251563:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc60d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.251570:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff94319746e300) 00010000:00010000:3.0:1787784808.251573:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784808.251576:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc60d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.251593:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc60d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.251923:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc5ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afda expref: 12 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.251939:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501400/0xffb8d925c20bc614 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afda expref: 11 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.251947:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9431861c2500) 00010000:00010000:3.0:1787784808.251950:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787784808.251952:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501400, rc 0) 00000100:00100000:3.0:1787784808.252055:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+11:17418:x1874627634807040:12345-192.168.202.59@tcp:101:bash.0 Request processed in 1445us (1881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784808.252065:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 27 00000100:00100000:2.0:1787784808.260942:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784808.261119:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634807296 00000100:00100000:1.0:1787784808.261132:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634807296 00000100:00100000:1.0:1787784808.261222:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 28 00000100:00100000:1.0:1787784808.261234:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf698b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+11:17418:x1874627634807296:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:1.0:1787784808.261261:0:18959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784808.261289:0:18959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc61b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849afe1 expref: -99 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.261668:0:18959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc622 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.261689:0:18959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc5f8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afd3 expref: 11 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.261701:0:18959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc622 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.261750:0:18959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc5f8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849afd3 expref: 11 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.261768:0:18959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc5f8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849afd3 expref: 11 pid: 18960 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784808.261787:0:18959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18959:1874627643191040:192.168.202.59@tcp:104: 00000100:00100000:1.0:1787784808.261913:0:18959:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431922f0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784808.267566:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784808.267676:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634807424 00000100:00100000:3.0:1787784808.267689:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634807424 00010000:00010000:3.0:1787784808.267744:0:18944:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc5f8 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849afd3 expref: 12 pid: 18960 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784808.267790:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:3.0:1787784808.267802:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bc1394c-7442-4c5c-9873-3edd9faa1a10+12:2362:x1874627634807424:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784808.267830:0:18944:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784808.267838:0:18944:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc5f8 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849afd3 expref: 12 pid: 18960 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.267876:0:18944:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc5f8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849afd3 expref: 12 pid: 18960 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.267908:0:18944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9431861c2500) 00010000:00010000:3.0:1787784808.267915:0:18944:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc622 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.267927:0:18944:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc622 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.267936:0:18944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc622 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.267960:0:18944:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784808.268119:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bc1394c-7442-4c5c-9873-3edd9faa1a10+12:2362:x1874627634807424:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 318us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784808.268129:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00010000:00010000:1.0:1787784808.268399:0:18959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc5f8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849afd3 expref: 11 pid: 18960 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784808.268427:0:18959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18959:1874627643191040:192.168.202.59@tcp:104: 00010000:00010000:1.0:1787784808.268451:0:18959:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc622 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.268470:0:18959:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc622 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.268477:0:18959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc622 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.268513:0:18959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc629 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.268523:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc629 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.268531:0:18959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc629 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.270052:0:18959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bc630 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.270077:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bc630 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.270092:0:18959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bc630 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784808.270110:0:18959:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787784808.270150:0:18959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc622 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.270166:0:18959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc622 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.270176:0:18959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc622 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.270183:0:18959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784808.270188:0:18959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc622 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.270196:0:18959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc622 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.270211:0:18959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9431861c2500) 00010000:00010000:1.0:1787784808.270214:0:18959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784808.270220:0:18959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc622 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.270226:0:18959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc622 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787784808.270245:0:18959:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000531b2c2d reply state 00000000bea525d8 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc629 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784808.270255:0:18959:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787784808.270306:0:18959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc61b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afe1 expref: 14 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.270324:0:18959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bc630 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afe1 expref: 13 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.270342:0:18959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486800) 00010000:00010000:1.0:1787784808.270345:0:18959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787784808.270348:0:18959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1c00, rc 0) 00000100:00100000:1.0:1787784808.270494:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf698b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+14:17418:x1874627634807296:12345-192.168.202.59@tcp:101:bash.0 Request processed in 9249us (9556us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1787784808.270504:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 28 00010000:00010000:1.0:1787784808.282407:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc629 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.282431:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc629 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.282440:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc629 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.282447:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784808.282454:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc629 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.282462:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc629 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.282495:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff943190486600) 00010000:00010000:1.0:1787784808.282500:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784808.282506:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc629 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.282513:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc629 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784808.297337:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784808.300276:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634807552 00000100:00100000:3.0:1787784808.300301:0:18961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634807552 00000100:00100000:3.0:1787784808.300599:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 29 00000100:00100000:3.0:1787784808.300614:0:18961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf698f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+13:17418:x1874627634807552:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:3.0:1787784808.300650:0:18961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784808.300680:0:18961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc63e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849afe8 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.300802:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc645 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.300843:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc645 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.300857:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc645 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784808.300914:0:18961:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787784808.300920:0:18961:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787784808.300958:0:18961:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc645 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.300970:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc645 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.301000:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc63e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afe8 expref: 15 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.301022:0:18961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc645 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afe8 expref: 14 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784808.301044:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486800) 00010000:00010000:3.0:1787784808.301047:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787784808.301052:0:18961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500400, rc 0) 00000100:00100000:3.0:1787784808.301160:0:18961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf698f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+14:17418:x1874627634807552:12345-192.168.202.59@tcp:101:bash.0 Request processed in 549us (3837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784808.301168:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 29 00000100:00100000:0.0:1787784808.316618:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784808.316699:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634807808 00000100:00100000:1.0:1787784808.316713:0:18963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634807808 00000100:00100000:1.0:1787784808.316783:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:1.0:1787784808.316795:0:18963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+14:17418:x1874627634807808:12345-192.168.202.59@tcp:35:bash.0 00000100:00100000:1.0:1787784808.317300:0:18963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+15:17418:x1874627634807808:12345-192.168.202.59@tcp:35:bash.0 Request processed in 505us (696us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1787784808.317310:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:1.0:1787784808.488546:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784808.488698:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634808064 00000100:00100000:2.0:1787784808.488712:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634808064 00000100:00100000:2.0:1787784808.488798:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00100000:2.0:1787784808.488812:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+15:17428:x1874627634808064:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784808.488848:0:19667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784808.488879:0:19667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc64c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849afef expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784808.489052:0:19667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787784808.492187:0:19667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc64c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afef expref: 17 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.492224:0:19667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94319746ed00) 00010000:00010000:2.0:1787784808.492227:0:19667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784808.492239:0:19667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc64c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afef expref: 17 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.492288:0:19667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431be795200, rc 0) 00000100:00100000:2.0:1787784808.493798:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+16:17428:x1874627634808064:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 4975us (5255us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1787784808.493815:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00100000:0.0:1787784808.499254:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784808.499835:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634808320 00000100:00100000:1.0:1787784808.499849:0:18963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634808320 00000100:00100000:1.0:1787784808.499932:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:1.0:1787784808.499945:0:18963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+16:17428:x1874627634808320:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:1.0:1787784808.500954:0:18963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+17:17428:x1874627634808320:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 1005us (1709us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1787784808.500967:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 6 00000040:00080000:3.0:1787784808.505200:0:18992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787784808.582112:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784808.582266:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634808576 00000100:00100000:2.0:1787784808.582280:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634808576 00000100:00100000:2.0:1787784808.582464:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 31 00000100:00100000:2.0:1787784808.582488:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+17:17431:x1874627634808576:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784808.582525:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784808.582556:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc65a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aff6 expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.582698:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795e00/0xffb8d925c20bc661 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.582716:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795e00/0xffb8d925c20bc661 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.582729:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795e00/0xffb8d925c20bc661 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784808.582853:0:18960:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787784808.583032:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc65a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aff6 expref: 20 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.583056:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795e00/0xffb8d925c20bc661 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aff6 expref: 19 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.583087:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486800) 00010000:00010000:2.0:1787784808.583091:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784808.583096:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431be795e00, rc 0) 00000100:00100000:2.0:1787784808.583238:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+19:17431:x1874627634808576:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 763us (1142us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1787784808.583247:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 31 00000100:00100000:2.0:1787784808.587016:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784808.587194:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634808704 00000100:00100000:1.0:1787784808.587207:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634808704 00000100:00100000:1.0:1787784808.587284:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 32 00000100:00100000:1.0:1787784808.587297:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+19:17431:x1874627634808704:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:1.0:1787784808.587435:0:18959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc66f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.587457:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc66f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.587472:0:18959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc66f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.587535:0:18959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc66f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.587544:0:18959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc66f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.587552:0:18959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc66f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.587559:0:18959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784808.587565:0:18959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc66f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.587573:0:18959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc66f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.587589:0:18959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486800) 00010000:00010000:1.0:1787784808.587593:0:18959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787784808.587598:0:18959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc66f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784808.587605:0:18959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc66f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784808.587702:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+19:17431:x1874627634808704:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 407us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784808.587710:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 32 00000100:00100000:0.0:1787784808.590085:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784808.590231:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634808832 00000100:00100000:2.0:1787784808.590245:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634808832 00000100:00100000:2.0:1787784808.590335:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:2.0:1787784808.590346:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+19:2365:x1874627634808832:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784808.590402:0:18946:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784808.590434:0:18946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795e00/0xffb8d925c20bc661 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aff6 expref: 19 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784808.590456:0:18946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486800) 00010000:00010000:2.0:1787784808.590462:0:18946:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784808.590540:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+18:2365:x1874627634808832:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 196us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784808.590548:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:0.0:1787784808.592969:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784808.593107:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634809088 00000100:00100000:2.0:1787784808.593120:0:18962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634809088 00000100:00100000:2.0:1787784808.593184:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:2.0:1787784808.593195:0:18962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+18:17431:x1874627634809088:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:2.0:1787784808.593545:0:18962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+19:17431:x1874627634809088:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 352us (589us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1787784808.593570:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00010000:00010000:1.0:1787784808.950139:0:20630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784809.107096:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784809.107276:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634809344 00000100:00100000:3.0:1787784809.107291:0:18961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634809344 00000100:00100000:3.0:1787784809.107461:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 33 00000100:00100000:3.0:1787784809.107490:0:18961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+19:17462:x1874627634809344:12345-192.168.202.59@tcp:101:cat.0 00010000:00010000:3.0:1787784809.107527:0:18961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784809.107559:0:18961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc676 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849affd expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.107699:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc67d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.107718:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc67d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.107733:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc67d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784809.107747:0:18961:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787784809.107920:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc676 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849affd expref: 22 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.107939:0:18961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc67d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849affd expref: 21 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.107946:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486800) 00010000:00010000:3.0:1787784809.107948:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787784809.107951:0:18961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500e00, rc 0) 00000100:00100000:3.0:1787784809.108024:0:18961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+21:17462:x1874627634809344:12345-192.168.202.59@tcp:101:cat.0 Request processed in 553us (947us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1787784809.108032:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 33 00000100:00080000:2.0:1787784809.108161:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784809.112641:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784809.112854:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784809.113304:0:21079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634809728 00000100:00100000:1.0:1787784809.113333:0:21079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634809728 00000100:00100000:1.0:1787784809.113442:0:21079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:1.0:1787784809.113466:0:21079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+21:2362:x1874627634809728:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784809.113503:0:21079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784809.113539:0:21079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc67d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849affd expref: 21 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.113564:0:21079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486800) 00010000:00010000:1.0:1787784809.113570:0:21079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784809.113645:0:21079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+20:2362:x1874627634809728:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 193us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784809.113654:0:21079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:2.0:1787784809.123798:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634809600 00000100:00100000:2.0:1787784809.123816:0:18962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634809600 00000100:00100000:2.0:1787784809.123898:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:2.0:1787784809.123912:0:18962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+20:17462:x1874627634809600:12345-192.168.202.59@tcp:35:cat.0 00000100:00100000:2.0:1787784809.126665:0:18962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+21:17462:x1874627634809600:12345-192.168.202.59@tcp:35:cat.0 Request processed in 2740us (14297us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1787784809.126683:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:0.0:1787784809.218642:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784809.218963:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634809984 00000100:00100000:1.0:1787784809.218978:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634809984 00000100:00100000:1.0:1787784809.219071:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 34 00000100:00100000:1.0:1787784809.219084:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+21:17468:x1874627634809984:12345-192.168.202.59@tcp:101:dd.0 00010000:00010000:1.0:1787784809.219120:0:18959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784809.219148:0:18959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc68b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849b004 expref: -99 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.219297:0:18959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc692 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.219316:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc692 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.219333:0:18959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc692 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784809.219405:0:18959:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787784809.219646:0:18959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc68b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b004 expref: 24 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.219671:0:18959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc692 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b004 expref: 23 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.219682:0:18959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486800) 00010000:00010000:1.0:1787784809.219685:0:18959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784809.219689:0:18959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d0000, rc 0) 00000100:00100000:1.0:1787784809.219781:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+23:17468:x1874627634809984:12345-192.168.202.59@tcp:101:dd.0 Request processed in 699us (1155us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1787784809.219791:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 34 00000100:00100000:0.0:1787784809.222976:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784809.224635:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634810240 00000100:00100000:1.0:1787784809.224654:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634810240 00000100:00100000:1.0:1787784809.224756:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 35 00000100:00100000:1.0:1787784809.224770:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+23:17468:x1874627634810240:12345-192.168.202.59@tcp:36:dd.0 00010000:00010000:1.0:1787784809.224851:0:18960:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787784809.224886:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc692 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b004 expref: 23 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.224915:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc645 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afe8 expref: 22 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.224927:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486800) 00010000:00010000:1.0:1787784809.224933:0:18960:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784809.225258:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc6a0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.225276:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc6a0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.225299:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc6a0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787784809.225398:0:18960:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:1.0:1787784809.225430:0:18960:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e15af30 reply state 000000005a2d6c8a transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc6a0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784809.225441:0:18960:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787784809.225583:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+24:17468:x1874627634810240:12345-192.168.202.59@tcp:36:dd.0 Request processed in 815us (2632us total) trans 12884901906 rc 0/0 00000100:00100000:1.0:1787784809.225592:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 35 00000020:00080000:1.0:1787784809.225598:0:18960:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787784809.232919:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc6a0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.232956:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc6a0 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.232964:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc6a0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.232971:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784809.232976:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc6a0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.232985:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc6a0 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.233006:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486800) 00010000:00010000:3.0:1787784809.233009:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784809.233015:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc6a0 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.233023:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc6a0 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784809.332814:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784809.332938:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634810496 00000100:00100000:1.0:1787784809.332951:0:18963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634810496 00000100:00100000:1.0:1787784809.333034:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:1.0:1787784809.333046:0:18963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+23:17468:x1874627634810496:12345-192.168.202.59@tcp:35:dd.0 00000100:00100000:1.0:1787784809.333416:0:18963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+24:17468:x1874627634810496:12345-192.168.202.59@tcp:35:dd.0 Request processed in 370us (998us total) trans 12884901907 rc 0/0 00000100:00100000:1.0:1787784809.333423:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:0.0:1787784809.561294:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784809.561419:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634810624 00000100:00100000:3.0:1787784809.561432:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634810624 00000100:00100000:3.0:1787784809.561532:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 36 00000100:00100000:3.0:1787784809.561545:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+24:17482:x1874627634810624:12345-192.168.202.59@tcp:101:stat.0 00010000:00010000:3.0:1787784809.561577:0:19667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784809.561719:0:19667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc6a7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849b00b expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.561879:0:19667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc6ae lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.561913:0:19667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc6ae lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.561929:0:19667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc6ae lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.561946:0:19667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc6b5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.561955:0:19667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc6b5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.561962:0:19667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc6b5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.562719:0:19667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc6bc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.562829:0:19667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc6bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.562841:0:19667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc6bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784809.562891:0:19667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787784809.562896:0:19667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787784809.562952:0:19667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc6bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.562967:0:19667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc6bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.562995:0:19667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc6ae lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.563001:0:19667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc6ae lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.563009:0:19667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc6ae lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.563088:0:19667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784809.563097:0:19667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc6ae lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.563106:0:19667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc6ae lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.563121:0:19667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9431861c2500) 00010000:00010000:3.0:1787784809.563124:0:19667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784809.563130:0:19667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc6ae lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.563136:0:19667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc6ae lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.563154:0:19667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc6b5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.563160:0:19667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc6b5 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.563167:0:19667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc6b5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.563180:0:19667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784809.563183:0:19667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc6b5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.563190:0:19667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc6b5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.563199:0:19667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff94319746e300) 00010000:00010000:3.0:1787784809.563202:0:19667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784809.563206:0:19667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc6b5 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.563288:0:19667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc6b5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.563337:0:19667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc6a7 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b00b expref: 26 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.563354:0:19667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc6bc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b00b expref: 25 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784809.563362:0:19667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486800) 00010000:00010000:3.0:1787784809.563520:0:19667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787784809.563524:0:19667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500400, rc 0) 00000100:00100000:3.0:1787784809.563630:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+25:17482:x1874627634810624:12345-192.168.202.59@tcp:101:stat.0 Request processed in 2085us (2422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784809.563642:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 36 00000100:00100000:3.0:1787784809.630252:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784809.630421:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634810880 00000100:00100000:1.0:1787784809.630435:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634810880 00000100:00100000:1.0:1787784809.630541:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 37 00000100:00100000:1.0:1787784809.630555:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431971170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+25:17488:x1874627634810880:12345-192.168.202.59@tcp:36:truncate.0 00010000:00010000:1.0:1787784809.630655:0:18960:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784809.630702:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bc6bc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b00b expref: 25 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.631173:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486800) 00010000:00010000:1.0:1787784809.631182:0:18960:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784809.631683:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc6c3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.631704:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc6c3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.631716:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc6c3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787784809.631792:0:18960:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:1.0:1787784809.631825:0:18960:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085b954d3 reply state 000000008acebdf2 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc6c3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784809.631836:0:18960:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787784809.632012:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431971170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+27:17488:x1874627634810880:12345-192.168.202.59@tcp:36:truncate.0 Request processed in 1456us (1921us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1787784809.632032:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 37 00000020:00080000:1.0:1787784809.632039:0:18960:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787784809.637760:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc6c3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.637783:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc6c3 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.637791:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc6c3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.637819:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784809.637825:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc6c3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.637833:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc6c3 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.637856:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486800) 00010000:00010000:1.0:1787784809.637859:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784809.637864:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc6c3 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.637870:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc6c3 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784809.782633:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787784809.782670:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643191168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784809.782779:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784809.782974:0:19648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643191168 00000100:00100000:0.0:1787784809.782988:0:19648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643191168 00000100:00080000:3.0:1787784809.783069:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784809.783090:0:19648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787784809.783102:0:19648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431971161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643191168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787784809.783152:0:19648:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1787784809.783222:0:19648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431971161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643191168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784809.783230:0:19648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787784809.783360:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643191168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784809.855824:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784809.855939:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634811008 00000100:00100000:1.0:1787784809.855957:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634811008 00000100:00100000:1.0:1787784809.856038:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 38 00000100:00100000:1.0:1787784809.856050:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+26:17502:x1874627634811008:12345-192.168.202.59@tcp:101:stat.0 00010000:00010000:1.0:1787784809.856089:0:18959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784809.856128:0:18959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc6ca lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849b012 expref: -99 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856229:0:18959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc6d1 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856249:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc6d1 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856263:0:18959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc6d1 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856304:0:18959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc6d8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856312:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc6d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856319:0:18959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc6d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856508:0:18959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044000/0xffb8d925c20bc6df lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856518:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044000/0xffb8d925c20bc6df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856526:0:18959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044000/0xffb8d925c20bc6df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784809.856576:0:18959:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1787784809.856582:0:18959:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787784809.856615:0:18959:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044000/0xffb8d925c20bc6df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856630:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044000/0xffb8d925c20bc6df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856638:0:18959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc6d1 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856644:0:18959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc6d1 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856662:0:18959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc6d1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856669:0:18959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784809.856674:0:18959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc6d1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856683:0:18959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc6d1 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856699:0:18959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9431861c2500) 00010000:00010000:1.0:1787784809.856702:0:18959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784809.856708:0:18959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc6d1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856715:0:18959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1600/0xffb8d925c20bc6d1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856732:0:18959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc6d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856739:0:18959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc6d8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856744:0:18959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc6d8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856748:0:18959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784809.856751:0:18959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc6d8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856768:0:18959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc6d8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856781:0:18959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff943190486600) 00010000:00010000:1.0:1787784809.856784:0:18959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784809.856788:0:18959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc6d8 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856793:0:18959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bc6d8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856832:0:18959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0000/0xffb8d925c20bc6ca lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b012 expref: 28 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856850:0:18959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044000/0xffb8d925c20bc6df lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b012 expref: 27 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784809.856858:0:18959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486800) 00010000:00010000:1.0:1787784809.856861:0:18959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784809.856864:0:18959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431c2044000, rc 0) 00000100:00100000:1.0:1787784809.856968:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+27:17502:x1874627634811008:12345-192.168.202.59@tcp:101:stat.0 Request processed in 918us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784809.856978:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 38 00010000:00010000:2.0:1787784809.972810:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784809.997511:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784809.997683:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634811264 00000100:00100000:2.0:1787784809.997697:0:18961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634811264 00000100:00100000:2.0:1787784809.997847:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 39 00000100:00100000:2.0:1787784809.997860:0:18961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+27:17512:x1874627634811264:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784809.997889:0:18961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784809.998269:0:18961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795e00/0xffb8d925c20bc6e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849b019 expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784809.998477:0:18961:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787784809.998717:0:18961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795e00/0xffb8d925c20bc6e6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b019 expref: 29 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784809.998801:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94319746ed00) 00010000:00010000:2.0:1787784809.998805:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784809.998812:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795e00/0xffb8d925c20bc6e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b019 expref: 29 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784809.998849:0:18961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431be795e00, rc 0) 00000100:00100000:2.0:1787784809.998960:0:18961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+28:17512:x1874627634811264:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1103us (1467us total) trans 12884901910 rc 301/301 00000100:00100000:2.0:1787784809.998971:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 39 00000100:00100000:3.0:1787784810.004380:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784810.004471:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634811520 00000100:00100000:1.0:1787784810.004486:0:18963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634811520 00000100:00100000:1.0:1787784810.004560:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:1.0:1787784810.004573:0:18963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187674050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+28:17512:x1874627634811520:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:1.0:1787784810.013561:0:18963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187674050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+29:17512:x1874627634811520:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 8969us (9191us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1787784810.013583:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:3.0:1787784810.128239:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784810.128461:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634811776 00000100:00100000:2.0:1787784810.128483:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634811776 00000100:00100000:2.0:1787784810.128641:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 40 00000100:00100000:2.0:1787784810.128655:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+29:17518:x1874627634811776:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1787784810.128689:0:19667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784810.128720:0:19667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795e00/0xffb8d925c20bc6f4 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849b020 expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.128906:0:19667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc6fb lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.128924:0:19667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bc630 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849afe1 expref: 30 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.128933:0:19667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044000/0xffb8d925c20bc6df lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b012 expref: 30 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.128942:0:19667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc6fb lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.128987:0:19667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044000/0xffb8d925c20bc6df lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849b012 expref: 30 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.129016:0:19667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044000/0xffb8d925c20bc6df lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849b012 expref: 30 pid: 18959 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784810.129033:0:19667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf69b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19667:1874627643191296:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784810.129178:0:19667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bc630 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849afe1 expref: 30 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.129189:0:19667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bc630 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849afe1 expref: 30 pid: 18959 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784810.129198:0:19667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf6983c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19667:1874627643191424:192.168.202.59@tcp:104: 00000100:00100000:2.0:1787784810.129226:0:19667:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf15fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787784810.135232:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784810.135481:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634811904 00000100:00100000:1.0:1787784810.135494:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634811904 00010000:00010000:1.0:1787784810.135553:0:18946:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044000/0xffb8d925c20bc6df lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849b012 expref: 31 pid: 18959 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784810.135608:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:1.0:1787784810.135620:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9536c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+31:2363:x1874627634811904:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784810.135643:0:18946:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784810.135651:0:18946:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044000/0xffb8d925c20bc6df lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849b012 expref: 31 pid: 18959 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.135668:0:18946:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044000/0xffb8d925c20bc6df lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849b012 expref: 31 pid: 18959 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.135699:0:18946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486800) 00010000:00010000:1.0:1787784810.135706:0:18946:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc6fb lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.135717:0:18946:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc6fb lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.135855:0:18946:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784810.135935:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9536c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+31:2363:x1874627634811904:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 316us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784810.135965:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:0.0:1787784810.136783:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784810.136848:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634812032 00000100:00100000:0.0:1787784810.136859:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634812032 00010000:00010000:0.0:1787784810.136899:0:18944:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bc630 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849afe1 expref: 31 pid: 18959 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784810.136930:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:0.0:1787784810.136938:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+31:2363:x1874627634812032:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784810.136953:0:18944:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784810.136959:0:18944:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bc630 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849afe1 expref: 31 pid: 18959 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.136973:0:18944:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bc630 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849afe1 expref: 31 pid: 18959 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.136992:0:18944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486800) 00010000:00010000:0.0:1787784810.137020:0:18944:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc6fb lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.137031:0:18944:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc6fb lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.137039:0:18944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc6fb lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.137065:0:18944:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784810.137108:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+31:2363:x1874627634812032:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 170us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784810.137116:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00010000:00010000:2.0:1787784810.137492:0:19667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044000/0xffb8d925c20bc6df lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849b012 expref: 30 pid: 18959 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784810.137515:0:19667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf69b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19667:1874627643191296:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784810.137530:0:19667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bc630 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849afe1 expref: 29 pid: 18959 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784810.137541:0:19667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf6983c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19667:1874627643191424:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784810.137574:0:19667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc6fb lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.137583:0:19667:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc6fb lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.137599:0:19667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc6fb lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784810.137626:0:19667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1787784810.138098:0:19667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795e00/0xffb8d925c20bc6f4 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b020 expref: 30 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.138116:0:19667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc6fb lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b020 expref: 29 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.138126:0:19667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486800) 00010000:00010000:2.0:1787784810.138129:0:19667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787784810.138132:0:19667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431be795200, rc 0) 00000100:00100000:2.0:1787784810.138179:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+29:17518:x1874627634811776:12345-192.168.202.59@tcp:101:bash.0 Request processed in 9528us (9955us total) trans 12884901912 rc 0/0 00000100:00100000:2.0:1787784810.138186:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 40 00000100:00100000:0.0:1787784810.142250:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784810.142674:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634812288 00000100:00100000:1.0:1787784810.142688:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634812288 00000100:00100000:1.0:1787784810.142915:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 41 00000100:00100000:1.0:1787784810.142929:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+29:17518:x1874627634812288:12345-192.168.202.59@tcp:36:bash.0 00010000:00010000:1.0:1787784810.143334:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045a00/0xffb8d925c20bc709 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.143357:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045a00/0xffb8d925c20bc709 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.143407:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045a00/0xffb8d925c20bc709 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787784810.143556:0:18960:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:1.0:1787784810.143586:0:18960:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059e8fb20 reply state 0000000078944cb1 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045a00/0xffb8d925c20bc709 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784810.143597:0:18960:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787784810.143851:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+32:17518:x1874627634812288:12345-192.168.202.59@tcp:36:bash.0 Request processed in 919us (1611us total) trans 12884901914 rc 0/0 00000100:00100000:1.0:1787784810.143865:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 41 00000020:00080000:1.0:1787784810.143874:0:18960:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787784810.150597:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045a00/0xffb8d925c20bc709 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.150619:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045a00/0xffb8d925c20bc709 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.150633:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045a00/0xffb8d925c20bc709 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.150639:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431c2045a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784810.150645:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045a00/0xffb8d925c20bc709 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.150655:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045a00/0xffb8d925c20bc709 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.150678:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486800) 00010000:00010000:0.0:1787784810.150682:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784810.150706:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045a00/0xffb8d925c20bc709 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.150713:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045a00/0xffb8d925c20bc709 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784810.150902:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784810.151215:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634812416 00000100:00100000:2.0:1787784810.151229:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634812416 00000100:00100000:2.0:1787784810.151309:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00100000:2.0:1787784810.151322:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189163c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+31:17518:x1874627634812416:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1787784810.151354:0:18959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784810.151413:0:18959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795600/0xffb8d925c20bc710 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849b027 expref: -99 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.151510:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795600/0xffb8d925c20bc710 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b027 expref: 32 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.151538:0:18959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795600/0xffb8d925c20bc710 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b027 expref: 32 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.151561:0:18959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486800) 00010000:00010000:2.0:1787784810.151564:0:18959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787784810.151566:0:18959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431be795600, rc 0) 00000100:00100000:2.0:1787784810.151644:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189163c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+32:17518:x1874627634812416:12345-192.168.202.59@tcp:101:bash.0 Request processed in 325us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784810.151652:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00100000:3.0:1787784810.159941:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784810.160670:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634812544 00000100:00100000:2.0:1787784810.160686:0:18961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634812544 00000100:00100000:2.0:1787784810.160783:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 43 00000100:00100000:2.0:1787784810.160795:0:18961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196291680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+32:17518:x1874627634812544:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1787784810.160825:0:18961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784810.160854:0:18961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795e00/0xffb8d925c20bc717 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849b02e expref: -99 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.160974:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc71e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.160993:0:18961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc6fb lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b020 expref: 33 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.161006:0:18961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc71e lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.161071:0:18961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc6fb lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849b020 expref: 33 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.161106:0:18961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc6fb lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849b020 expref: 33 pid: 19667 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784810.161124:0:18961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf6983c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18961:1874627643191552:192.168.202.59@tcp:104: 00000100:00100000:2.0:1787784810.161273:0:18961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf15fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787784810.173291:0:18961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf6983c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18961:1874627643191552:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784810.173335:0:18961:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc71e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784810.174996:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784810.175690:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634812672 00000100:00100000:1.0:1787784810.175704:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634812672 00010000:00010000:1.0:1787784810.175782:0:18946:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc6fb lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849b020 expref: 34 pid: 19667 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784810.175868:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:1.0:1787784810.175880:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196291e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+34:2363:x1874627634812672:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784810.175900:0:18946:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784810.175909:0:18946:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc6fb lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849b020 expref: 34 pid: 19667 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.175925:0:18946:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc6fb lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849b020 expref: 34 pid: 19667 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.175956:0:18946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795200/0xffb8d925c20bc6fb lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849b020 expref: 34 pid: 19667 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.175975:0:18946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486800) 00010000:00010000:1.0:1787784810.176195:0:18946:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc71e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.176208:0:18946:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc71e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.176218:0:18946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc71e lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.176255:0:18946:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784810.176712:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196291e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+33:2363:x1874627634812672:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 828us (1728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784810.176724:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00010000:00010000:3.0:1787784810.176889:0:18961:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc71e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.176900:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc71e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784810.176964:0:18961:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787784810.176970:0:18961:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787784810.177016:0:18961:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc71e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.177063:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795e00/0xffb8d925c20bc717 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b02e expref: 33 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.177083:0:18961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc71e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b02e expref: 32 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.177093:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486800) 00010000:00010000:3.0:1787784810.177096:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787784810.177113:0:18961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431be794000, rc 0) 00000100:00100000:3.0:1787784810.177156:0:18961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196291680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+32:17518:x1874627634812544:12345-192.168.202.59@tcp:101:bash.0 Request processed in 16364us (17230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784810.177164:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 43 00000100:00100000:1.0:1787784810.182788:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784810.183336:0:21079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634812928 00000100:00100000:0.0:1787784810.183350:0:21079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634812928 00000100:00100000:0.0:1787784810.183489:0:21079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:0.0:1787784810.183503:0:21079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189161680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+32:17518:x1874627634812928:12345-192.168.202.59@tcp:103:bash.0 00010000:00010000:0.0:1787784810.183525:0:21079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787784810.183559:0:21079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be794000/0xffb8d925c20bc71e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b02e expref: 32 pid: 18961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.183585:0:21079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431be795600/0xffb8d925c20bc710 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b027 expref: 31 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.183598:0:21079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486800) 00010000:00010000:0.0:1787784810.183621:0:21079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784810.183693:0:21079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189161680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+30:17518:x1874627634812928:12345-192.168.202.59@tcp:103:bash.0 Request processed in 192us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784810.183701:0:21079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:2.0:1787784810.187886:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784810.188158:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634813056 00000100:00100000:1.0:1787784810.188172:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634813056 00000100:00100000:1.0:1787784810.188243:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 44 00000100:00100000:1.0:1787784810.188253:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf6983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+30:17518:x1874627634813056:12345-192.168.202.59@tcp:58:bash.0 00010000:00010000:1.0:1787784810.188829:0:18959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044a00/0xffb8d925c20bc725 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.188852:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044a00/0xffb8d925c20bc725 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.188866:0:18959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044a00/0xffb8d925c20bc725 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787784810.191329:0:18959:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787784810.193989:0:18959:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1787784810.194829:0:18959:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1787784810.195145:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf6983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+30:17518:x1874627634813056:12345-192.168.202.59@tcp:58:bash.0 Request processed in 6883us (7263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784810.195173:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 44 00000100:00100000:1.0:1787784810.199796:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784810.199910:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634813184 00000100:00100000:0.0:1787784810.199923:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634813184 00000100:00100000:0.0:1787784810.200166:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00100000:0.0:1787784810.200181:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431891621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+30:17518:x1874627634813184:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:0.0:1787784810.200209:0:18960:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784810.200236:0:18960:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bc72c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849b035 expref: -99 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.200346:0:18960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044a00/0xffb8d925c20bc725 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.200359:0:18960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bc72c lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b035 expref: 31 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.200407:0:18960:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044a00/0xffb8d925c20bc725 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.200423:0:18960:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bc72c lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b035 expref: 31 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.200439:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486600) 00010000:00010000:0.0:1787784810.200642:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787784810.200648:0:18960:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bc72c lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b035 expref: 31 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.200659:0:18960:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88000, rc 0) 00000100:00100000:0.0:1787784810.200813:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431891621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+31:17518:x1874627634813184:12345-192.168.202.59@tcp:101:bash.0 Request processed in 635us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784810.200822:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 45 00000001:00080000:1.0:1787784810.401732:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901914 is committed 00000001:00080000:1.0:1787784810.401783:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000040:00080000:3.0:1787784810.548897:0:18992:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787784810.548912:0:18992:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787784810.548963:0:18992:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1787784810.548970:0:18992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1787784810.549484:0:18992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196292d00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18992:1874627643191680:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787784810.549632:0:18992:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee3840 going to sleep for 11 seconds 00000100:00100000:3.0:1787784810.552949:0:18992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196292d00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18992:1874627643191680:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787784810.557426:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784810.558080:0:18970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634813312 00000100:00100000:3.0:1787784810.558094:0:18970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634813312 00000100:00100000:3.0:1787784810.558172:0:18970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:3.0:1787784810.558185:0:18970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+10:17519:x1874627634813312:12345-192.168.202.59@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787784810.558801:0:18970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+10:17519:x1874627634813312:12345-192.168.202.59@tcp:900:lhsmtool_posix.0 Request processed in 615us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784810.558812:0:18970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:1.0:1787784810.570549:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784810.570760:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634813440 00000100:00100000:0.0:1787784810.570774:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634813440 00000100:00100000:0.0:1787784810.570865:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00100000:0.0:1787784810.570878:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431891603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+10:17519:x1874627634813440:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787784810.570929:0:19667:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787784810.571120:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431891603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+10:17519:x1874627634813440:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 244us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784810.571128:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00100000:2.0:1787784810.578554:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784810.579680:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634813568 00000100:00100000:3.0:1787784810.579696:0:18961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634813568 00000100:00100000:3.0:1787784810.579788:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 47 00000100:00100000:3.0:1787784810.579803:0:18961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+10:17519:x1874627634813568:12345-192.168.202.59@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787784810.579915:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc733 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.579939:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc733 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.579973:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc733 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.579995:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc73a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.580003:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc73a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.580010:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc73a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.580043:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc741 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.580053:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc741 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.580060:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc741 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784810.580121:0:18961:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787784810.580127:0:18961:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787784810.580151:0:18961:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc741 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.580166:0:18961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc733 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.580174:0:18961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc733 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.581326:0:18961:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc733 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.581345:0:18961:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784810.581351:0:18961:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc733 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.581380:0:18961:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc733 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.581405:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9431861c2b00) 00010000:00010000:3.0:1787784810.581410:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784810.581416:0:18961:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc733 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.581422:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc733 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.581891:0:18961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc73a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.581902:0:18961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc73a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.581909:0:18961:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc73a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.581915:0:18961:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784810.581918:0:18961:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc73a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.581946:0:18961:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc73a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.581957:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff94319746e300) 00010000:00010000:3.0:1787784810.581960:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784810.581963:0:18961:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc73a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.581969:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc73a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.581992:0:18961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc741 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.581998:0:18961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc741 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.582004:0:18961:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc741 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.582010:0:18961:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784810.582013:0:18961:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc741 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.582019:0:18961:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc741 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.582029:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486600) 00010000:00010000:3.0:1787784810.582033:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784810.582037:0:18961:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc741 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.582056:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc741 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784810.582352:0:18961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+10:17519:x1874627634813568:12345-192.168.202.59@tcp:34:lhsmtool_posix.0 Request processed in 2545us (3811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784810.582415:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 47 00000100:00100000:2.0:1787784810.597656:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784810.603398:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634813824 00000100:00100000:0.0:1787784810.603422:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634813824 00000100:00100000:0.0:1787784810.603544:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 48 00000100:00100000:0.0:1787784810.603557:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+10:17519:x1874627634813824:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787784810.603589:0:19667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784810.603621:0:19667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bc748 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849b03c expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.603771:0:19667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88800/0xffb8d925c20bc74f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.603792:0:19667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88800/0xffb8d925c20bc74f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.603806:0:19667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88800/0xffb8d925c20bc74f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784810.603819:0:19667:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787784810.605360:0:19667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88800/0xffb8d925c20bc74f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.605392:0:19667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88800/0xffb8d925c20bc74f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.605401:0:19667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88800/0xffb8d925c20bc74f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.605408:0:19667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88800 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784810.605434:0:19667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88800/0xffb8d925c20bc74f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.605617:0:19667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88800/0xffb8d925c20bc74f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.605639:0:19667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486600) 00010000:00010000:0.0:1787784810.605643:0:19667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784810.605650:0:19667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88800/0xffb8d925c20bc74f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.605658:0:19667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88800/0xffb8d925c20bc74f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.605754:0:19667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bc748 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b03c expref: 12 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.605767:0:19667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9431861c2b00) 00010000:00010000:0.0:1787784810.605770:0:19667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787784810.605774:0:19667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bc748 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b03c expref: 12 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.605785:0:19667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88400, rc 0) 00000100:00100000:0.0:1787784810.605955:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+11:17519:x1874627634813824:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 2398us (8316us total) trans 12884901915 rc 301/301 00000100:00100000:0.0:1787784810.605965:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 48 00000100:00100000:1.0:1787784810.614556:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784810.615015:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634813952 00000100:00100000:0.0:1787784810.615030:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634813952 00000100:00100000:0.0:1787784810.615108:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00100000:0.0:1787784810.615120:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189162940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+11:17519:x1874627634813952:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787784810.615184:0:18960:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787784810.615339:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189162940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+11:17519:x1874627634813952:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 221us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784810.615348:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00100000:2.0:1787784810.624111:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784810.626137:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634814208 00000100:00100000:1.0:1787784810.626160:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634814208 00000100:00100000:1.0:1787784810.626274:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 50 00000100:00100000:1.0:1787784810.626288:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+11:17519:x1874627634814208:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787784810.626317:0:18959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784810.626415:0:18959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044800/0xffb8d925c20bc75d lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849b043 expref: -99 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787784810.627512:0:18959:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x23:0x0], count =31 00000004:00080000:1.0:1787784810.627524:0:18959:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x23:0x0]+31 in llog 00000004:00080000:1.0:1787784810.627580:0:18959:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x42:0x0], index 0: 0 00010000:00010000:1.0:1787784810.627946:0:18959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044600/0xffb8d925c20bc764 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.627965:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044600/0xffb8d925c20bc764 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.627979:0:18959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044600/0xffb8d925c20bc764 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.628061:0:18959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044800/0xffb8d925c20bc75d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b043 expref: 14 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.628086:0:18959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044600/0xffb8d925c20bc764 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b043 expref: 13 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.628095:0:18959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff943190486f00) 00010000:00010000:1.0:1787784810.628097:0:18959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784810.628102:0:18959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431c2044600, rc 0) 00000100:00100000:1.0:1787784810.628199:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+13:17519:x1874627634814208:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 1914us (4117us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1787784810.628210:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 50 00000100:00100000:2.0:1787784810.640744:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784810.641009:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634814464 00000100:00100000:1.0:1787784810.641024:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634814464 00000100:00100000:1.0:1787784810.641104:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 51 00000100:00100000:1.0:1787784810.641133:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+13:17519:x1874627634814464:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787784810.641216:0:18960:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784810.641254:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044600/0xffb8d925c20bc764 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b043 expref: 13 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.641291:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff943190486f00) 00010000:00010000:1.0:1787784810.641305:0:18960:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784810.641338:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045400/0xffb8d925c20bc772 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.641355:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045400/0xffb8d925c20bc772 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.641411:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045400/0xffb8d925c20bc772 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.641431:0:18960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045c00/0xffb8d925c20bc779 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x7caed83e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.641575:0:18960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045c00/0xffb8d925c20bc779 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7caed83e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.641585:0:18960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045c00/0xffb8d925c20bc779 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7caed83e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.641965:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045400/0xffb8d925c20bc772 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.641975:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045400/0xffb8d925c20bc772 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.641995:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045400/0xffb8d925c20bc772 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.642002:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431c2045400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784810.642008:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045400/0xffb8d925c20bc772 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.642018:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045400/0xffb8d925c20bc772 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.642029:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9431861c2500) 00010000:00010000:1.0:1787784810.642032:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784810.642037:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045400/0xffb8d925c20bc772 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.642043:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045400/0xffb8d925c20bc772 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.642055:0:18960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045c00/0xffb8d925c20bc779 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7caed83e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.642062:0:18960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045c00/0xffb8d925c20bc779 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7caed83e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.642069:0:18960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045c00/0xffb8d925c20bc779 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7caed83e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.642074:0:18960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431c2045c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784810.642077:0:18960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045c00/0xffb8d925c20bc779 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7caed83e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.642094:0:18960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045c00/0xffb8d925c20bc779 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7caed83e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.642102:0:18960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x7caed83e (ffff943190486b00) 00010000:00010000:1.0:1787784810.642104:0:18960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784810.642107:0:18960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045c00/0xffb8d925c20bc779 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x7caed83e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.642113:0:18960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045c00/0xffb8d925c20bc779 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x7caed83e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784810.642237:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+12:17519:x1874627634814464:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 1102us (1524us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787784810.642246:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 51 00000100:00100000:3.0:1787784810.644857:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784810.645076:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634814592 00000100:00100000:1.0:1787784810.645090:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634814592 00000100:00100000:1.0:1787784810.645172:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 52 00000100:00100000:1.0:1787784810.645185:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196292d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+12:17519:x1874627634814592:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787784810.645214:0:18959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784810.645247:0:18959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045a00/0xffb8d925c20bc780 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849b04a expref: -99 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.645409:0:18959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045000/0xffb8d925c20bc787 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.645427:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045000/0xffb8d925c20bc787 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.646348:0:18959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045000/0xffb8d925c20bc787 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.650263:0:18959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045a00/0xffb8d925c20bc780 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b04a expref: 14 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.651118:0:18959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045000/0xffb8d925c20bc787 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b04a expref: 13 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.651131:0:18959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff943190486c00) 00010000:00010000:2.0:1787784810.651135:0:18959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787784810.651140:0:18959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431c2045000, rc 0) 00000100:00100000:2.0:1787784810.651260:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196292d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+13:17519:x1874627634814592:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 6074us (6416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784810.651361:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 52 00000100:00100000:2.0:1787784810.654199:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784810.654600:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634814848 00000100:00100000:3.0:1787784810.654619:0:18961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634814848 00000100:00100000:3.0:1787784810.654728:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 53 00000100:00100000:3.0:1787784810.654741:0:18961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d26d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+13:17519:x1874627634814848:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787784810.654867:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc78e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.654892:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc78e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.654909:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc78e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787784810.655839:0:18961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:3.0:1787784810.655860:0:18961:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625482493574ns, next at 626482489167ns, rc = 0 00000004:00010000:3.0:1787784810.655998:0:18961:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051dfe99a reply state 00000000aad20246 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc78e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784810.656011:0:18961:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787784810.657259:0:18961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d26d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+15:17519:x1874627634814848:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 2510us (3063us total) trans 12884901917 rc 0/0 00000100:00100000:2.0:1787784810.657272:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 53 00010000:00010000:1.0:1787784810.665949:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc78e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.665973:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc78e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.665982:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc78e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.665990:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784810.665996:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc78e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.666013:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc78e lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.666037:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff943190486c00) 00010000:00010000:1.0:1787784810.666040:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787784810.666047:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc78e lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.666054:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bc78e lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784810.668740:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784810.669169:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634814976 00000100:00100000:0.0:1787784810.669183:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634814976 00000100:00100000:0.0:1787784810.669289:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 54 00000100:00100000:0.0:1787784810.669301:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+14:17519:x1874627634814976:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787784810.669334:0:19667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784810.669415:0:19667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bc795 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849b051 expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.669545:0:19667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bc795 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b051 expref: 15 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.669567:0:19667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bc795 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b051 expref: 15 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.669597:0:19667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff943190486c00) 00010000:00010000:0.0:1787784810.669602:0:19667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787784810.669607:0:19667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88400, rc 0) 00000100:00100000:0.0:1787784810.669706:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+15:17519:x1874627634814976:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 406us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784810.670638:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 54 00000100:00100000:3.0:1787784810.677720:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784810.677835:0:20123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634815104 00000100:00100000:2.0:1787784810.677854:0:20123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634815104 00000100:00100000:2.0:1787784810.677975:0:20123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:2.0:1787784810.677989:0:20123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+5:2363:x1874627634815104:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787784810.678600:0:20123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+6:2363:x1874627634815104:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 Request processed in 613us (895us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1787784810.678624:0:20123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00080000:3.0:1787784810.679082:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784810.682703:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784810.682848:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634815360 00000100:00100000:2.0:1787784810.682860:0:18962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634815360 00000100:00100000:2.0:1787784810.682953:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:2.0:1787784810.682967:0:18962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197114780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+15:17519:x1874627634815360:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787784810.683333:0:18962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197114780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+16:17519:x1874627634815360:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 368us (645us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1787784810.683342:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:1.0:1787784810.685572:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784810.685673:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634815616 00000100:00100000:0.0:1787784810.685688:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634815616 00000100:00100000:0.0:1787784810.685886:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 55 00000100:00100000:0.0:1787784810.685904:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197115e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+16:17519:x1874627634815616:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787784810.686071:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197115e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+16:17519:x1874627634815616:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 172us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784810.686080:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 55 00000100:00100000:3.0:1787784810.694717:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784810.694874:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634815744 00000100:00100000:0.0:1787784810.694888:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634815744 00000100:00100000:0.0:1787784810.694962:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 56 00000100:00100000:0.0:1787784810.694974:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+16:17519:x1874627634815744:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787784810.695003:0:19667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784810.695043:0:19667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88800/0xffb8d925c20bc79c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849b058 expref: -99 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.695170:0:19667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bc7a3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.695192:0:19667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bc7a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.695344:0:19667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bc7a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784810.695466:0:19667:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787784810.695494:0:19667:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bc7a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.695529:0:19667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88800/0xffb8d925c20bc79c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b058 expref: 18 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.695582:0:19667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bc7a3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b058 expref: 17 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.695595:0:19667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff943190486c00) 00010000:00010000:0.0:1787784810.695599:0:19667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787784810.695686:0:19667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88200, rc 0) 00000100:00100000:0.0:1787784810.695879:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+17:17519:x1874627634815744:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 903us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784810.695889:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 56 00000100:00100000:1.0:1787784810.702890:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784810.703079:0:19645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634815872 00000100:00100000:2.0:1787784810.703093:0:19645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634815872 00000100:00100000:2.0:1787784810.703170:0:19645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:2.0:1787784810.703182:0:19645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+6:2362:x1874627634815872:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784810.703230:0:19645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784810.703258:0:19645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d5e19f/0xffb8d925c20bc7aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849b05f expref: -99 pid: 19645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787784810.703307:0:19645:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f6e6a, blocks: 0x1 00010000:00010000:2.0:1787784810.703333:0:19645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=625s v=(0 0) 00010000:00010000:2.0:1787784810.703339:0:19645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784810.703352:0:19645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d5e19f/0xffb8d925c20bc7aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b05f expref: 7 pid: 19645 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.703573:0:19645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000016d5e19f/0xffb8d925c20bc7aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b05f expref: 7 pid: 19645 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.703593:0:19645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431be795400, rc 0) 00000100:00100000:2.0:1787784810.703677:0:19645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+7:2362:x1874627634815872:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 497us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784810.703686:0:19645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:1.0:1787784810.706797:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784810.709560:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634816128 00000100:00100000:0.0:1787784810.709584:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634816128 00000100:00100000:0.0:1787784810.710332:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 57 00000100:00100000:0.0:1787784810.710350:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+17:17519:x1874627634816128:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787784810.710559:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+17:17519:x1874627634816128:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 214us (3776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784810.710569:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 57 00000100:00100000:3.0:1787784810.713192:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784810.720957:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634816256 00000100:00100000:2.0:1787784810.720984:0:18961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634816256 00000100:00100000:2.0:1787784810.721105:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 58 00000100:00100000:2.0:1787784810.721118:0:18961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196290780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+17:17519:x1874627634816256:12345-192.168.202.59@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787784810.763212:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901915 is committed 00000001:00080000:3.0:1787784810.763236:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901916 is committed 00000001:00080000:3.0:1787784810.763245:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:3.0:1787784810.763254:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1787784810.764408:0:18961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196290780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+13:17519:x1874627634816256:12345-192.168.202.59@tcp:44:lhsmtool_posix.0 Request processed in 43282us (51219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784810.764425:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 58 00000100:00100000:3.0:1787784810.765359:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643191808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787784810.765483:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784810.765660:0:19643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643191808 00000100:00100000:0.0:1787784810.765672:0:19643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643191808 00000100:00100000:0.0:1787784810.766177:0:19643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787784810.766190:0:19643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196293c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643191808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787784810.766494:0:19643:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787784810.766512:0:19643:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787784810.766515:0:19643:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787784810.766517:0:19643:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1787784810 -> 1787784810 00002000:00010000:0.0:1787784810.766520:0:19643:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787784810.766592:0:19643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196293c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643191808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 404us (1109us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1787784810.766614:0:19643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1787784810.767393:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff943196293480/2, rc 0, transno 12884901891 00000100:00100000:3.0:1787784810.767404:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643191808:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787784810.767930:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784810.768231:0:21095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634816384 00000100:00100000:0.0:1787784810.768242:0:21095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634816384 00000100:00100000:0.0:1787784810.768305:0:21095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:0.0:1787784810.768316:0:21095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d27c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+7:2363:x1874627634816384:12345-192.168.202.59@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787784810.769544:0:21095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d27c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+7:2363:x1874627634816384:12345-192.168.202.59@tcp:16:lhsmtool_posix.0 Request processed in 1221us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784810.769557:0:21095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:0.0:1787784810.771929:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784810.772020:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634816640 00000100:00100000:3.0:1787784810.772032:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634816640 00000100:00100000:3.0:1787784810.772099:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 59 00000100:00100000:3.0:1787784810.772110:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+13:17519:x1874627634816640:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787784810.772191:0:18959:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784810.772226:0:18959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bc7a3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b058 expref: 13 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.772250:0:18959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff943190486c00) 00010000:00010000:3.0:1787784810.772256:0:18959:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787784810.772295:0:18959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc7b1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.772312:0:18959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc7b1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.772323:0:18959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc7b1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787784810.772656:0:18959:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2118f3c reply state 000000001b55399a transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc7b1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784810.772667:0:18959:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787784810.773203:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+14:17519:x1874627634816640:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 1091us (1281us total) trans 12884901919 rc 0/0 00000100:00100000:3.0:1787784810.773213:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 59 00000100:00100000:3.0:1787784810.777078:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00010000:00010000:0.0:1787784810.777218:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc7b1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.777236:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc7b1 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.777246:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc7b1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.777254:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784810.777260:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc7b1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.777270:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc7b1 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.777316:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff943190486c00) 00010000:00010000:0.0:1787784810.777320:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784810.777327:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc7b1 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.777334:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc7b1 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784810.778110:0:19645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634816768 00000100:00100000:2.0:1787784810.778127:0:19645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634816768 00000100:00100000:2.0:1787784810.778217:0:19645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:2.0:1787784810.778229:0:19645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196292580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+7:17519:x1874627634816768:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784810.778266:0:19645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784810.778289:0:19645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e97c0f8/0xffb8d925c20bc7b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849b066 expref: -99 pid: 19645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.778328:0:19645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000016d5e19f/0xffb8d925c20bc7aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b05f expref: 8 pid: 19645 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.778340:0:19645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784810.778346:0:19645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784810.778352:0:19645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e97c0f8/0xffb8d925c20bc7b8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b066 expref: 8 pid: 19645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.778442:0:19645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000016d5e19f/0xffb8d925c20bc7aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849b05f expref: 8 pid: 19645 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.778469:0:19645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000016d5e19f/0xffb8d925c20bc7aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849b05f expref: 8 pid: 19645 timeout: 725 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784810.778485:0:19645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d243c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:19645:1874627643191936:192.168.202.59@tcp:104: 00000100:00100000:2.0:1787784810.778589:0:19645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431833d4900 going to sleep for 11 seconds 00000100:00100000:3.0:1787784810.782689:0:19645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d243c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:19645:1874627643191936:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784810.782888:0:19645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000e97c0f8/0xffb8d925c20bc7b8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849b066 expref: 8 pid: 19645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.782915:0:19645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431be794600, rc 0) 00000100:00100000:3.0:1787784810.782991:0:19645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196292580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+8:17519:x1874627634816768:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 4762us (5930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784810.783002:0:19645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:1.0:1787784810.783271:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784810.784571:0:18944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634816896 00000100:00100000:0.0:1787784810.784590:0:18944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634816896 00010000:00010000:0.0:1787784810.784667:0:18944:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000016d5e19f/0xffb8d925c20bc7aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849b05f expref: 8 pid: 19645 timeout: 725 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784810.784734:0:18944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:0.0:1787784810.784746:0:18944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45aed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+8:2362:x1874627634816896:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784810.784766:0:18944:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784810.784796:0:18944:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000016d5e19f/0xffb8d925c20bc7aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849b05f expref: 8 pid: 19645 timeout: 725 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.784811:0:18944:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000016d5e19f/0xffb8d925c20bc7aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849b05f expref: 8 pid: 19645 timeout: 725 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.784842:0:18944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d5e19f/0xffb8d925c20bc7aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849b05f expref: 8 pid: 19645 timeout: 725 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.784861:0:18944:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784810.784883:0:18944:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784810.784892:0:18944:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e97c0f8/0xffb8d925c20bc7b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x845202732849b066 expref: 7 pid: 19645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.784904:0:18944:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e97c0f8/0xffb8d925c20bc7b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x845202732849b066 expref: 7 pid: 19645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.784952:0:18944:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000e97c0f8/0xffb8d925c20bc7b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849b066 expref: 7 pid: 19645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784810.784970:0:18944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40e1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:18944:1874627643192064:192.168.202.59@tcp:105: 00000100:00100000:0.0:1787784810.785075:0:18944:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431843a3840 going to sleep for 11 seconds 00000100:00100000:0.0:1787784810.788206:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784810.788473:0:20123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634817024 00000100:00100000:3.0:1787784810.788486:0:20123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634817024 00000100:00100000:3.0:1787784810.788559:0:20123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:3.0:1787784810.788571:0:20123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+8:2363:x1874627634817024:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787784810.788888:0:20123:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787784810.788893:0:20123:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1787784810 00002000:00010000:3.0:1787784810.788896:0:20123:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 1787784808 00002000:00010000:3.0:1787784810.788898:0:20123:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1787784810 -> 1787784810 00002000:00010000:3.0:1787784810.788901:0:20123:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787784810.789000:0:20123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+9:2363:x1874627634817024:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 Request processed in 431us (807us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1787784810.789009:0:20123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:2.0:1787784810.789600:0:18944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40e1c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:18944:1874627643192064:192.168.202.59@tcp:105: 00010000:00010000:2.0:1787784810.789643:0:18944:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784810.789694:0:18944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45aed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+8:2362:x1874627634816896:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 4950us (6424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784810.789705:0:18944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:0.0:1787784810.792581:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784810.792775:0:21095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634817152 00000100:00100000:2.0:1787784810.792789:0:21095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634817152 00000100:00100000:2.0:1787784810.792864:0:21095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:2.0:1787784810.792876:0:21095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+8:2362:x1874627634817152:12345-192.168.202.59@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787784810.792939:0:21095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009ce47ea8/0xffb8d925c20bc7bf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.792964:0:21095:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e97c0f8/0xffb8d925c20bc7b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849b066 expref: 8 pid: 19645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.792975:0:21095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784810.792980:0:21095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787784810.792986:0:21095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce47ea8/0xffb8d925c20bc7bf lrc: 4/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.793150:0:21095:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000e97c0f8/0xffb8d925c20bc7b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.59@tcp remote: 0x845202732849b066 expref: 8 pid: 19645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.793169:0:21095:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000e97c0f8/0xffb8d925c20bc7b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849b066 expref: 8 pid: 19645 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784810.793187:0:21095:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d25a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21095:1874627643192192:192.168.202.59@tcp:104: 00000100:00100000:2.0:1787784810.793294:0:21095:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431833d4900 going to sleep for 11 seconds 00000100:00100000:3.0:1787784810.796093:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784810.796135:0:21079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634817280 00000100:00100000:3.0:1787784810.796144:0:21079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634817280 00010000:00010000:3.0:1787784810.796195:0:21079:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000e97c0f8/0xffb8d925c20bc7b8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849b066 expref: 9 pid: 19645 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784810.796241:0:21079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:3.0:1787784810.796251:0:21079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196290b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+9:2363:x1874627634817280:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784810.796271:0:21079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784810.796302:0:21079:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000e97c0f8/0xffb8d925c20bc7b8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849b066 expref: 9 pid: 19645 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.796318:0:21079:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000e97c0f8/0xffb8d925c20bc7b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849b066 expref: 9 pid: 19645 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.796351:0:21079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784810.796356:0:21079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784810.796389:0:21079:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ce47ea8/0xffb8d925c20bc7bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.796403:0:21079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce47ea8/0xffb8d925c20bc7bf lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.796451:0:21079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787784810.796778:0:21095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e97c0f8/0xffb8d925c20bc7b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.59@tcp remote: 0x845202732849b066 expref: 9 pid: 19645 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784810.796798:0:21095:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d25a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21095:1874627643192192:192.168.202.59@tcp:104: 00010000:00010000:0.0:1787784810.796826:0:21095:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ce47ea8/0xffb8d925c20bc7bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.796838:0:21095:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ce47ea8/0xffb8d925c20bc7bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.796845:0:21095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce47ea8/0xffb8d925c20bc7bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.796887:0:21095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009ce47ea8/0xffb8d925c20bc7bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.796896:0:21095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce47ea8/0xffb8d925c20bc7bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.796904:0:21095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce47ea8/0xffb8d925c20bc7bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.796913:0:21095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431be795800 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784810.796918:0:21095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce47ea8/0xffb8d925c20bc7bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.796928:0:21095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce47ea8/0xffb8d925c20bc7bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.796943:0:21095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce47ea8/0xffb8d925c20bc7bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.796951:0:21095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce47ea8/0xffb8d925c20bc7bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784810.797339:0:21079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196290b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+8:2363:x1874627634817280:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 1087us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784810.797350:0:21079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:0.0:1787784810.797500:0:21095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+7:2362:x1874627634817152:12345-192.168.202.59@tcp:1:lhsmtool_posix.0 Request processed in 4626us (4933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784810.797522:0:21095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:3.0:1787784810.802812:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784810.802885:0:19667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634817536 00000100:00100000:1.0:1787784810.802912:0:19667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634817536 00000100:00100000:1.0:1787784810.802983:0:19667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 60 00000100:00100000:1.0:1787784810.802994:0:19667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196290f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+13:17519:x1874627634817536:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787784810.803110:0:19667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044800/0xffb8d925c20bc7c6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.803132:0:19667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044800/0xffb8d925c20bc7c6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.803147:0:19667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044800/0xffb8d925c20bc7c6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.803467:0:19667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044600/0xffb8d925c20bc7cd lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.803480:0:19667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bc795 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b051 expref: 14 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.803489:0:19667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044600/0xffb8d925c20bc7cd lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.803536:0:19667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bc795 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849b051 expref: 14 pid: 19667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.803554:0:19667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bc795 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849b051 expref: 14 pid: 19667 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784810.803575:0:19667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a4780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19667:1874627643192320:192.168.202.59@tcp:104: 00000100:00100000:1.0:1787784810.804122:0:19667:0:(client.c:2715:ptlrpc_set_wait()) set ffff943190875600 going to sleep for 11 seconds 00000100:00100000:3.0:1787784810.807253:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784810.807451:0:19667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a4780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19667:1874627643192320:192.168.202.59@tcp:104: 00010000:00010000:1.0:1787784810.807510:0:19667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044600/0xffb8d925c20bc7cd lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784810.807794:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634817664 00000100:00100000:2.0:1787784810.807804:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634817664 00010000:00010000:2.0:1787784810.807860:0:18946:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bc795 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849b051 expref: 15 pid: 19667 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784810.807916:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:2.0:1787784810.807930:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431be7da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+15:2362:x1874627634817664:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784810.807950:0:18946:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784810.807960:0:18946:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bc795 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849b051 expref: 15 pid: 19667 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.807975:0:18946:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bc795 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849b051 expref: 15 pid: 19667 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.808003:0:18946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bc795 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849b051 expref: 15 pid: 19667 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.808137:0:18946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff943190486c00) 00010000:00010000:2.0:1787784810.808144:0:18946:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044600/0xffb8d925c20bc7cd lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.808155:0:18946:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044600/0xffb8d925c20bc7cd lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.808164:0:18946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044600/0xffb8d925c20bc7cd lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784810.808188:0:18946:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784810.808250:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431be7da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+14:2362:x1874627634817664:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 324us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784810.808258:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 16 00010000:00010000:1.0:1787784810.808400:0:19667:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044600/0xffb8d925c20bc7cd lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.808408:0:19667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044600/0xffb8d925c20bc7cd lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787784810.808676:0:19667:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:1.0:1787784810.808862:0:19667:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:1.0:1787784810.808916:0:19667:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:1.0:1787784810.809149:0:19667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a4780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19667:1874627643192448:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787784810.809245:0:19667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784810.809285:0:19667:0:(client.c:2715:ptlrpc_set_wait()) set ffff943190875180 going to sleep for 11 seconds 00000100:00100000:2.0:1787784810.809882:0:18964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643192448 00000100:00100000:2.0:1787784810.809898:0:18964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643192448 00000100:00100000:2.0:1787784810.809944:0:18964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787784810.809954:0:18964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19667:x1874627643192448:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787784810.810143:0:18964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19667:x1874627643192448:12345-0@lo:1000:mdt00_003.0 Request processed in 190us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784810.810151:0:18964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784810.810285:0:19667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a4780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19667:1874627643192448:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787784810.816252:0:19667:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:1.0:1787784810.816415:0:19667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a4780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19667:1874627643192576:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787784810.816526:0:19667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784810.816599:0:18964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643192576 00000100:00100000:1.0:1787784810.816608:0:18964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643192576 00000100:00100000:1.0:1787784810.816680:0:18964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784810.816690:0:18964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19667:x1874627643192576:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787784810.816985:0:18964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:19667:x1874627643192576:12345-0@lo:1000:mdt00_003.0 Request processed in 293us (456us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1787784810.816994:0:18964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784810.817177:0:19667:0:(client.c:2715:ptlrpc_set_wait()) set ffff943190875600 going to sleep for 11 seconds 00000100:00100000:1.0:1787784810.817220:0:19667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a4780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19667:1874627643192576:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787784810.817278:0:19667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044600/0xffb8d925c20bc7cd lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.817291:0:19667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044600/0xffb8d925c20bc7cd lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.817299:0:19667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044600/0xffb8d925c20bc7cd lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.817305:0:19667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431c2044600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784810.817311:0:19667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044600/0xffb8d925c20bc7cd lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.817319:0:19667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044600/0xffb8d925c20bc7cd lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.817339:0:19667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff943190486c00) 00010000:00010000:1.0:1787784810.817342:0:19667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787784810.817348:0:19667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044600/0xffb8d925c20bc7cd lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.817355:0:19667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044600/0xffb8d925c20bc7cd lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.817419:0:19667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044a00/0xffb8d925c20bc725 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.817426:0:19667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044a00/0xffb8d925c20bc725 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.817431:0:19667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044a00/0xffb8d925c20bc725 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.817448:0:19667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431c2044a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784810.817452:0:19667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044a00/0xffb8d925c20bc725 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784810.820271:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d24780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643192960:0@lo:400:kworker.0 00000100:00100000:2.0:1787784810.820403:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784810.820451:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784810.820471:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643192832:0@lo:400:kworker.0 00000100:00100000:2.0:1787784810.820504:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784810.821681:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d25680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17693f43-cfcf-4d1e-8495-73723b171a31:3294:1874627643192704:0@lo:400:kworker.0 00000100:00100000:3.0:1787784810.821763:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784810.821811:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d27840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643193216:0@lo:400:kworker.0 00000100:00100000:3.0:1787784810.821844:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784810.821873:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787784810.821879:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d26940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1874627643193088:0@lo:400:kworker.0 00000100:00100000:3.0:1787784810.821904:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784810.821948:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643192960 00000100:00100000:3.0:1787784810.821958:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643192960 00000100:00100000:3.0:1787784810.822003:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643193216 00000100:00100000:3.0:1787784810.822006:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643193216 00000100:00100000:3.0:1787784810.822046:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643193088 00000100:00100000:3.0:1787784810.822049:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643193088 00000100:00100000:3.0:1787784810.822069:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787784810.822079:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643192960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784810.822150:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643192960:12345-0@lo:400:kworker.0 Request processed in 72us (1747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784810.822158:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787784810.822177:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787784810.822183:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431be7dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643193216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784810.822236:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431be7dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643193216:12345-0@lo:400:kworker.0 Request processed in 53us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784810.822243:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787784810.822256:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787784810.822262:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431be7d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874627643193088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784810.822289:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431be7d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874627643193088:12345-0@lo:400:kworker.0 Request processed in 28us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784810.822295:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787784810.822319:0:19645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643192832 00000100:00100000:3.0:1787784810.822324:0:19645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643192832 00000100:00100000:3.0:1787784810.822355:0:19645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787784810.822362:0:19645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d25e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643192832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784810.822430:0:19645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d25e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643192832:12345-0@lo:400:kworker.0 Request processed in 69us (1926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784810.822437:0:19645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1787784810.822473:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787784810.822478:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784810.822515:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d26940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1874627643193088:0@lo:400:kworker.0 00000100:00100000:3.0:1787784810.822527:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d27840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643193216:0@lo:400:kworker.0 00000100:00100000:3.0:1787784810.822568:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643192832:0@lo:400:kworker.0 00000100:00100000:3.0:1787784810.822580:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d24780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643192960:0@lo:400:kworker.0 00000100:00100000:0.0:1787784810.822876:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643192704 00000100:00100000:0.0:1787784810.822881:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643192704 00000100:00100000:0.0:1787784810.822919:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787784810.822926:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430826c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+19:3294:x1874627643192704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784810.822971:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430826c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17693f43-cfcf-4d1e-8495-73723b171a31+19:3294:x1874627643192704:12345-0@lo:400:kworker.0 Request processed in 46us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784810.822978:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787784810.823384:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d25680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17693f43-cfcf-4d1e-8495-73723b171a31:3294:1874627643192704:0@lo:400:kworker.0 00010000:00010000:1.0:1787784810.823832:0:19667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044a00/0xffb8d925c20bc725 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.824672:0:19667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486600) 00010000:00010000:1.0:1787784810.824680:0:19667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787784810.824691:0:19667:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bc72c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b035 expref: 17 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.824706:0:19667:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bc72c lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b035 expref: 17 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.824728:0:19667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bc72c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b035 expref: 17 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.824819:0:19667:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bc72c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b035 expref: 17 pid: 18960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784810.824837:0:19667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19667:1874627643193344:192.168.202.59@tcp:105: 00000100:00100000:1.0:1787784810.824938:0:19667:0:(client.c:2715:ptlrpc_set_wait()) set ffff943190875600 going to sleep for 11 seconds 00000100:00100000:3.0:1787784810.829146:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784810.829280:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634817792 00000100:00100000:0.0:1787784810.829293:0:18963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634817792 00000100:00100000:0.0:1787784810.829390:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:0.0:1787784810.829407:0:18963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431be7da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+18:17518:x1874627634817792:12345-192.168.202.59@tcp:49:bash.0 00000100:00100000:0.0:1787784810.829610:0:18963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431be7da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+18:17518:x1874627634817792:12345-192.168.202.59@tcp:49:bash.0 Request processed in 209us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784810.829620:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:1.0:1787784810.830283:0:19667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19667:1874627643193344:192.168.202.59@tcp:105: 00010000:00010000:1.0:1787784810.830322:0:19667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044a00/0xffb8d925c20bc725 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.830351:0:19667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044a00/0xffb8d925c20bc725 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 18959 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.830421:0:19667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045400/0xffb8d925c20bc7d4 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.830439:0:19667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045400/0xffb8d925c20bc7d4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.830452:0:19667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045400/0xffb8d925c20bc7d4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.830472:0:19667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045400/0xffb8d925c20bc7d4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.830479:0:19667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045400/0xffb8d925c20bc7d4 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.830486:0:19667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045400/0xffb8d925c20bc7d4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.830492:0:19667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431c2045400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784810.830496:0:19667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045400/0xffb8d925c20bc7d4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.830505:0:19667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045400/0xffb8d925c20bc7d4 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.830519:0:19667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486600) 00010000:00010000:1.0:1787784810.830522:0:19667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784810.830526:0:19667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045400/0xffb8d925c20bc7d4 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.830539:0:19667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2045400/0xffb8d925c20bc7d4 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.830552:0:19667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044800/0xffb8d925c20bc7c6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.830558:0:19667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044800/0xffb8d925c20bc7c6 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.830578:0:19667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044800/0xffb8d925c20bc7c6 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.830584:0:19667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431c2044800 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784810.830587:0:19667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044800/0xffb8d925c20bc7c6 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.830594:0:19667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044800/0xffb8d925c20bc7c6 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.830602:0:19667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486600) 00010000:00010000:1.0:1787784810.830604:0:19667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787784810.830607:0:19667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044800/0xffb8d925c20bc7c6 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784810.830613:0:19667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431c2044800/0xffb8d925c20bc7c6 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19667 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784810.830910:0:19667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196290f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+17:17519:x1874627634817536:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 27916us (28110us total) trans 12884901924 rc 0/0 00000100:00100000:1.0:1787784810.830921:0:19667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 60 00000020:00080000:1.0:1787784810.830932:0:19667:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787784810.833969:0:18992:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787784810.833985:0:18992:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787784810.834169:0:18992:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1787784810.834177:0:18992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1787784810.834595:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784810.834977:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634817920 00000100:00100000:0.0:1787784810.834989:0:19646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634817920 00000100:00100000:0.0:1787784810.835555:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:0.0:1787784810.835570:0:19646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431be7d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+7:17518:x1874627634817920:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:0.0:1787784810.835596:0:19646:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784810.835627:0:19646:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bc7db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849b06d expref: -99 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787784810.835678:0:19646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x6a8f6e6a, atime: 0x6a8f6e68, ctime: 0x6a8f6e6a, blocks: 0x1 00010000:00010000:0.0:1787784810.835774:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=625s v=(0 0) 00010000:00010000:0.0:1787784810.835781:0:19646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784810.835794:0:19646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bc7db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b06d expref: 8 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.835814:0:19646:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bc7db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b06d expref: 8 pid: 19646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.835829:0:19646:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89200, rc 0) 00000100:00100000:0.0:1787784810.835907:0:19646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431be7d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+8:17518:x1874627634817920:12345-192.168.202.59@tcp:101:bash.0 Request processed in 341us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784810.835914:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:3.0:1787784810.836443:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784810.836494:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634818176 00000100:00100000:3.0:1787784810.836502:0:18963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634818176 00000100:00100000:3.0:1787784810.836544:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:3.0:1787784810.836552:0:18963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431be7d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+17:17519:x1874627634818176:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787784810.837487:0:18963:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787784810.837648:0:18963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:3.0:1787784810.837707:0:18963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc7e2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.837728:0:18963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc7e2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.837741:0:18963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc7e2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.837750:0:18963:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc7e2 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.837757:0:18963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc7e2 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.837763:0:18963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc7e2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.837787:0:18963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787784810.837910:0:18963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431be7d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+19:17519:x1874627634818176:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 1356us (1468us total) trans 12884901926 rc 0/0 00000100:00100000:3.0:1787784810.837920:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00000020:00080000:3.0:1787784810.837925:0:18963:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787784810.837984:0:18948:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784810.837991:0:18948:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc7e2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.837999:0:18948:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784810.838004:0:18948:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc7e2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.838014:0:18948:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc7e2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.838028:0:18948:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff943190486c00) 00010000:00010000:3.0:1787784810.838031:0:18948:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787784810.838036:0:18948:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc7e2 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.838043:0:18948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc7e2 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.838056:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784810.838058:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784810.838059:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784810.839466:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784810.839497:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d24b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643193472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784810.839583:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784810.839826:0:19647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643193472 00000100:00100000:0.0:1787784810.839838:0:19647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643193472 00000100:00100000:0.0:1787784810.839911:0:19647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787784810.839922:0:19647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643193472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784810.839971:0:19647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787784810.840042:0:19647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643193472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784810.840049:0:19647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787784810.840103:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d24b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643193472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784810.847831:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784810.848062:0:18963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634818432 00000100:00100000:3.0:1787784810.848075:0:18963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634818432 00000100:00100000:3.0:1787784810.848181:0:18963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:3.0:1787784810.848195:0:18963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+19:17518:x1874627634818432:12345-192.168.202.59@tcp:35:bash.0 00000001:00080000:3.0:1787784810.848586:0:18963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:3.0:1787784810.850195:0:18963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:3.0:1787784810.850427:0:18963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+22:17518:x1874627634818432:12345-192.168.202.59@tcp:35:bash.0 Request processed in 2229us (2605us total) trans 12884901929 rc 0/0 00000100:00100000:3.0:1787784810.850441:0:18963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 14 00000020:00080000:3.0:1787784810.850465:0:18963:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000001:00080000:2.0:1787784810.928873:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901891 is committed 00000001:00080000:2.0:1787784810.928903:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00080000:2.0:1787784810.928910:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901892 is committed 00000100:00100000:3.0:1787784810.951524:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784810.952193:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634818688 00000100:00100000:0.0:1787784810.952207:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634818688 00000100:00100000:0.0:1787784810.952317:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 61 00000100:00100000:0.0:1787784810.952336:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431be7db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+22:17529:x1874627634818688:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784810.952425:0:18959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784810.952467:0:18959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bc7e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849b074 expref: -99 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784810.952856:0:18959:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787784810.953955:0:18959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bc7e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b074 expref: 24 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.953981:0:18959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94319746ed00) 00010000:00010000:0.0:1787784810.953985:0:18959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787784810.953992:0:18959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bc7e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849b074 expref: 24 pid: 18959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784810.954131:0:18959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88400, rc 0) 00000100:00100000:0.0:1787784810.954285:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431be7db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+23:17529:x1874627634818688:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1957us (2776us total) trans 12884901930 rc 301/301 00000100:00100000:0.0:1787784810.954296:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 61 00000100:00100000:1.0:1787784810.963683:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784810.963831:0:18961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634818816 00000100:00100000:3.0:1787784810.963845:0:18961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634818816 00000100:00100000:3.0:1787784810.963922:0:18961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 62 00000100:00100000:3.0:1787784810.963934:0:18961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+23:17529:x1874627634818816:12345-192.168.202.59@tcp:34:lfs.0 00010000:00010000:3.0:1787784810.964153:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc7f7 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.964174:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc7f7 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.964189:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc7f7 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.964217:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc7fe lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.964226:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc7fe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.964233:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc7fe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965136:0:18961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc805 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965151:0:18961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc805 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965160:0:18961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc805 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787784810.965232:0:18961:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc805 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965249:0:18961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc7f7 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965256:0:18961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc7f7 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965263:0:18961:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc7f7 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965270:0:18961:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784810.965274:0:18961:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc7f7 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965283:0:18961:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc7f7 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965297:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9431861c2500) 00010000:00010000:3.0:1787784810.965300:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784810.965305:0:18961:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc7f7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965314:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bc7f7 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965329:0:18961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc7fe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965335:0:18961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc7fe lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965347:0:18961:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc7fe lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965352:0:18961:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500e00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784810.965355:0:18961:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc7fe lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965361:0:18961:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc7fe lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965522:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff94319746e300) 00010000:00010000:3.0:1787784810.965524:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784810.965528:0:18961:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc7fe lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965534:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bc7fe lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965549:0:18961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc805 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965555:0:18961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc805 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965560:0:18961:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc805 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965566:0:18961:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784810.965568:0:18961:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc805 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965585:0:18961:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc805 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965594:0:18961:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff943190486600) 00010000:00010000:3.0:1787784810.965597:0:18961:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784810.965600:0:18961:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc805 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784810.965622:0:18961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bc805 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18961 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784810.965823:0:18961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+23:17529:x1874627634818816:12345-192.168.202.59@tcp:34:lfs.0 Request processed in 1885us (2149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784810.965834:0:18961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 62 00000100:00100000:2.0:1787784810.971111:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784810.971416:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634819072 00000100:00100000:3.0:1787784810.971430:0:18962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634819072 00000100:00100000:3.0:1787784810.971529:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:3.0:1787784810.971542:0:18962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+23:17529:x1874627634819072:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:3.0:1787784810.972532:0:18962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+24:17529:x1874627634819072:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 986us (1439us total) trans 12884901931 rc 0/0 00000100:00100000:3.0:1787784810.972544:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 15 00010000:00010000:1.0:1787784810.996991:0:20630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784812.020730:0:18947:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787784812.950756:0:21135:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:2.0:1787784813.063789:0:18948:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784813.323500:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784813.323558:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784813.323597:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784813.323622:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784813.323654:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784813.323678:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784813.323705:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784813.323741:0:19645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634819456 00000100:00100000:1.0:1787784813.323753:0:19645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634819456 00000100:00100000:1.0:1787784813.323827:0:19645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634819968 00000100:00100000:1.0:1787784813.323831:0:19645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634819968 00000100:00100000:1.0:1787784813.323845:0:19645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634819584 00000100:00100000:1.0:1787784813.323848:0:19645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634819584 00000100:00100000:1.0:1787784813.323863:0:19645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634819840 00000100:00100000:1.0:1787784813.323865:0:19645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634819840 00000100:00100000:1.0:1787784813.323883:0:19645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:1.0:1787784813.323894:0:19645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+6:2364:x1874627634819456:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784813.324002:0:19645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+6:2364:x1874627634819456:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 109us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784813.324010:0:19645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:1.0:1787784813.324031:0:19645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:1.0:1787784813.324038:0:19645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6bc1394c-7442-4c5c-9873-3edd9faa1a10+5:2364:x1874627634819968:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784813.324066:0:19645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6bc1394c-7442-4c5c-9873-3edd9faa1a10+5:2364:x1874627634819968:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 29us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784813.324072:0:19645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:1.0:1787784813.324101:0:19645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:1.0:1787784813.324106:0:19645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba259a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+5:2364:x1874627634819584:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784813.324129:0:19645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba259a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+5:2364:x1874627634819584:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 24us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784813.324134:0:19645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:1.0:1787784813.324144:0:19645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:1.0:1787784813.324149:0:19645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba258780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6bc1394c-7442-4c5c-9873-3edd9faa1a10+5:2364:x1874627634819840:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784813.324171:0:19645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba258780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6bc1394c-7442-4c5c-9873-3edd9faa1a10+5:2364:x1874627634819840:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 22us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784813.324328:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634819712 00000100:00100000:0.0:1787784813.324333:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634819712 00000100:00100000:0.0:1787784813.324410:0:18959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634819328 00000100:00100000:0.0:1787784813.324414:0:18959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634819328 00000100:00100000:0.0:1787784813.324446:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 26 00000100:00100000:0.0:1787784813.324454:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6bc1394c-7442-4c5c-9873-3edd9faa1a10+6:2364:x1874627634819712:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784813.324491:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6bc1394c-7442-4c5c-9873-3edd9faa1a10+6:2364:x1874627634819712:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 39us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784813.324507:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 26 00000100:00100000:0.0:1787784813.324524:0:18959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 27 00000100:00100000:0.0:1787784813.324529:0:18959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+24:2364:x1874627634819328:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784813.324555:0:18959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+24:2364:x1874627634819328:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 26us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784813.324560:0:18959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 27 00000100:00080000:0.0:1787784813.324589:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784813.324594:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787784813.324596:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784813.324760:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634819200 00000100:00100000:2.0:1787784813.324765:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634819200 00000100:00100000:2.0:1787784813.324805:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 124 00000100:00100000:2.0:1787784813.324812:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430826c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+13:2364:x1874627634819200:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784813.324840:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430826c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3c44031-71ab-414a-bb9a-73f59e219c51+13:2364:x1874627634819200:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 30us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784813.324855:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 124 00000100:00100000:1.0:1787784813.325264:0:19645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 18 00010000:00010000:0.0:1787784814.077665:0:20630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784814.342441:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784814.342485:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784814.342640:0:19649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634820096 00000100:00100000:2.0:1787784814.342650:0:19649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634820096 00002000:00100000:2.0:1787784814.342704:0:19649:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x42:0x0] (0->8) req@ffff9431be7d8780 x1874627634820096/t0(0) o4->c1ecce4d-d802-4177-ac8b-b53f5aa1fa65@192.168.202.59@tcp:695/0 lens 504/0 e 0 to 0 dl 1787784825 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787784814.342715:0:19649:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9431be7d8780 with x1874627634820096 ext(0->8) 00002000:00010000:2.0:1787784814.342721:0:19649:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9431be7d8780 00000100:00100000:2.0:1787784814.342751:0:19649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:2.0:1787784814.342761:0:19649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431be7d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+6:2364:x1874627634820096:12345-192.168.202.59@tcp:4:bash.0 00000100:00100000:2.0:1787784814.343228:0:19649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431be7d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+8:2364:x1874627634820096:12345-192.168.202.59@tcp:4:bash.0 Request processed in 467us (741us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1787784814.343236:0:19649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 0 00002000:00100000:2.0:1787784814.343255:0:19649:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x42:0x0] (0->8) req@ffff9431be7d8780 x1874627634820096/t12884901894(0) o4->c1ecce4d-d802-4177-ac8b-b53f5aa1fa65@192.168.202.59@tcp:695/0 lens 504/448 e 0 to 0 dl 1787784825 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787784814.343264:0:19649:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9431be7d8780 with x1874627634820096 ext(0->8) 00002000:00010000:2.0:1787784814.343268:0:19649:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9431be7d8780 00000100:00100000:0.0:1787784814.344513:0:21095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634820224 00000100:00100000:0.0:1787784814.344521:0:21095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634820224 00000100:00100000:0.0:1787784814.344571:0:21095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:0.0:1787784814.344579:0:21095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431be7db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+8:2364:x1874627634820224:12345-192.168.202.59@tcp:16:kworker.0 00000001:00080000:2.0:1787784814.473998:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901893 is committed 00000001:00080000:2.0:1787784814.474016:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00000100:00100000:0.0:1787784814.474716:0:21095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431be7db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c1ecce4d-d802-4177-ac8b-b53f5aa1fa65+6:2364:x1874627634820224:12345-192.168.202.59@tcp:16:kworker.0 Request processed in 130131us (132292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784814.474728:0:21095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:1.0:1787784814.903434:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784814.903460:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba2583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643193600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784814.903545:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784814.903842:0:19647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643193600 00000100:00100000:0.0:1787784814.903851:0:19647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643193600 00000100:00100000:0.0:1787784814.903923:0:19647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787784814.903935:0:19647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba259e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643193600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787784814.903958:0:19647:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3851419648 avail 3848273920 00000100:00100000:0.0:1787784814.904004:0:19647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba259e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643193600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784814.904012:0:19647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787784814.904065:0:3295:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901893 gen 2 00000004:00080000:0.0:1787784814.904072:0:3295:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff943196293480, transno 12884901891 00000004:00080000:0.0:1787784814.904085:0:3295:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901893 committed transno 12884901893 00000100:00100000:0.0:1787784814.904116:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba2583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643193600:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787784814.905628:0:18955:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 Debug log: 9987 lines, 9987 kept, 0 dropped, 0 bad.